-- Logs begin at Mon 2022-10-10 11:12:54 UTC, end at Mon 2022-10-10 12:32:15 UTC. -- Oct 10 11:58:34.012810 dv-cinder-860209-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 11:58:34.022145 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 11:58:34 2022] *** Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: nodename: dv-cinder-860209-4-iscsi Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: machine: x86_64 Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: clock source: unix Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: pcre jit disabled Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: detected number of CPU cores: 4 Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: current working directory: / Oct 10 11:58:34.024190 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: detected binary path: /usr/bin/uwsgi-core Oct 10 11:58:34.024890 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: your processes number limit is 47680 Oct 10 11:58:34.024890 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: your memory page size is 4096 bytes Oct 10 11:58:34.024890 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: detected max file descriptor number: 2048 Oct 10 11:58:34.024890 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: lock engine: pthread robust mutexes Oct 10 11:58:34.024890 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: thunder lock: enabled Oct 10 11:58:34.024890 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 11:58:34.024890 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 11:58:34.063256 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: Python main interpreter initialized at 0x55eceb39a9c0 Oct 10 11:58:34.063256 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: python threads support enabled Oct 10 11:58:34.063256 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: your server socket listen backlog is limited to 100 connections Oct 10 11:58:34.063256 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: your mercy for graceful operations on workers is 90 seconds Oct 10 11:58:34.063599 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 11:58:34.063676 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: *** Operational MODE: preforking *** Oct 10 11:58:34.063912 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: *** uWSGI is running in multiple interpreter mode *** Oct 10 11:58:34.063912 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: spawned uWSGI master process (pid: 106222) Oct 10 11:58:34.064120 dv-cinder-860209-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 10 11:58:34.066708 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: spawned uWSGI worker 1 (pid: 106223, cores: 1) Oct 10 11:58:34.066708 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: spawned uWSGI worker 2 (pid: 106224, cores: 1) Oct 10 11:58:34.066708 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 11:58:34.722023 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 11:58:34.722624 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 11:58:35.803719 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:35.803719 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: from cryptography.utils import int_from_bytes Oct 10 11:58:35.804378 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:35.804378 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: from cryptography.utils import int_from_bytes Oct 10 11:58:35.807155 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:35.807155 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: from cryptography.utils import int_from_bytes Oct 10 11:58:35.807572 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:58:35.807572 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: from cryptography.utils import int_from_bytes Oct 10 11:58:38.266980 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:58:38.267638 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:58:38.267809 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:58:38.268093 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:58:38.268343 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:58:38.268486 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:58:38.268893 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.269055 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:58:38.269219 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.269349 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:58:38.269487 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.269619 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.269761 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:58:38.269900 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:58:38.270030 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.270240 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.270378 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.270559 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.270717 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.270893 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.271026 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.271208 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.271419 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.271559 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.271687 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.271836 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.271992 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.272125 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-4-iscsi {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.272259 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.272402 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.272529 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.272662 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.272823 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.272986 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.273110 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.273245 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.273384 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.273518 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.273646 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-4-iscsi {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.273779 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.273907 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.274077 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.274201 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.274489 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.274627 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.274815 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.275016 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.275197 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.275323 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.275446 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.275570 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.275774 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.275922 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.276373 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.276508 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.276629 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.276729 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.276836 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.276939 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.277038 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.277129 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.277362 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.277491 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.277666 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.277797 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.278026 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-4-iscsi {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.278166 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.278336 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.278474 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.278637 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.279344 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.279466 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.279578 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.279805 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.280244 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.280244 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.280483 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-4-iscsi {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.280582 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.280687 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.280803 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.280910 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.281187 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.281318 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.281446 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.281628 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.281757 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.282026 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.282280 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.282450 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.282581 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.282753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.282913 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.283132 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.283268 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.283398 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.283527 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.283656 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.283819 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.283819 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284061 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284204 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284333 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284463 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284595 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284726 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284854 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.284991 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.285299 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.285425 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.285564 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.285686 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.285818 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.285953 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.286077 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.286217 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.286340 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.286477 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.286599 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.286753 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.286889 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287028 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287151 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287279 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287412 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287540 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287661 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287856 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.287979 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.288102 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.288238 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.288361 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.288492 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.288613 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.288741 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.288898 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.289029 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.289198 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.289336 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.289507 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.289639 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.289811 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.289934 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.290123 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.290247 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.290420 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.290567 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.290764 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.290884 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.291098 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.291228 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.291349 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.291477 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.291626 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.291750 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.291949 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.292073 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.292262 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.292456 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.292612 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.292766 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.292922 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.293072 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.293239 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.293409 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.293562 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.293718 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.293869 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.294022 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.294173 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.294318 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.295123 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.295307 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.295529 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.295686 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.295834 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.295986 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.296139 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.296309 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.296464 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.296622 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.296768 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.296916 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.297061 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.297217 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.297372 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.297372 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.297662 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.297808 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.297961 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.298118 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.298289 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.298451 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.298615 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.298779 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.298940 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.299087 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.299247 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.299392 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.299537 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.299688 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.299841 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.299990 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.300141 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.300299 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.300494 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.300657 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.300814 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.300960 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.301114 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.301260 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.301410 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.301555 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.301708 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.301865 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.302010 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.302162 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.302321 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.302505 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.302712 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.302884 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.303031 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.303176 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.303333 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.303503 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.303664 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.303823 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.303973 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.304130 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.304287 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.304448 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.304605 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.304776 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.304936 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.305105 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.305257 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.305407 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.305586 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.305803 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.305960 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.306108 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.306258 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.306417 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.306574 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.306794 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.306951 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.307101 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.307252 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.307405 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.307555 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.307719 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.307719 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.307999 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.308149 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.308304 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.308455 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.308608 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.308756 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.308916 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.309059 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.309211 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.309372 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.309524 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.309667 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.309808 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.309958 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.310108 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.310250 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.310391 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.310566 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.310752 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.310924 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.311076 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.311221 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.311366 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.311519 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.311670 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.311826 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.311972 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.312125 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.312270 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.312414 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.312575 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.312773 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.312932 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.313079 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.313232 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.313399 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.313581 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.313744 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.313896 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.314054 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.314205 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.314355 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.314519 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:58:38.314725 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.314879 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.315034 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.315187 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.315338 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.315506 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.315666 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.315827 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.316039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.316185 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.316345 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.316497 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.316652 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.316804 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.316956 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.317107 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.317261 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.317261 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.317558 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.317816 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.317991 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.318139 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.318285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.318440 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.318592 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.318768 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.318932 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.319081 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.319240 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.319409 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.319571 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.319728 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.319879 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.320033 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.320191 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.320340 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.320489 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.320667 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.320837 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.320995 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.321232 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.321383 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.321532 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.321684 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.321833 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.321993 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.322151 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.322307 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.322462 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.322618 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.322841 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.323017 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.323172 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.323324 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.323469 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.323638 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.323803 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.323957 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.324118 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.324269 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.324414 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.324564 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.324708 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.324865 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.325017 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.325170 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.325315 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.325465 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.325630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.325785 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.325931 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.326161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.326316 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.326461 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.326620 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.326790 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.326949 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.327099 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.327248 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.327397 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.327397 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.327695 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.327844 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.327999 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.328149 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.328299 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.328462 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.328612 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.328760 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.328914 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.329064 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.329212 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.329371 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.329520 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.329668 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.329815 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.329971 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.330120 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.330276 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.330458 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.330622 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.330885 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.331044 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.331199 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.331352 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.331498 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.331642 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.331791 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.331934 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.332091 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.332244 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.332389 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.332544 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.332691 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.332851 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.333065 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.333217 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.333362 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.333507 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.333652 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.333827 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.334000 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.334153 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.334299 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.334444 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.334588 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.334774 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.334932 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.335086 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.335232 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.335386 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.335550 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.335741 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.335890 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.336036 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.336197 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.336435 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.336593 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.336751 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.336905 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.337057 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.337205 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.337351 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.337495 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.337667 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.337851 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.338025 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.338178 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.338361 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.338523 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.338717 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.338882 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.339036 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.339181 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.339324 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.339479 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.339625 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.339770 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.339913 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.340066 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.340210 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.340368 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.340513 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.340664 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.340847 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.340999 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.341154 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.341800 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.341948 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.342110 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.342264 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.342409 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.342633 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.342633 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.342967 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.343151 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.343324 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.343471 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.343637 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.343784 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.343954 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.344121 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.344271 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.344419 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.344577 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.344727 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.344875 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.345026 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.345175 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.345323 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.345484 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.345640 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.345790 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.345938 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.346087 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.346245 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.346417 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.346642 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.346828 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.346973 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.347121 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.347121 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.347420 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.347563 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.347712 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.347871 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348038 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348193 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348337 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348479 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348622 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348773 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348916 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.348916 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.349198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.349341 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.349512 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.349658 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.349838 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.349983 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.350127 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.350280 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.350433 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.350577 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.350762 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.350949 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.351102 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.351249 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.351396 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.351548 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.351705 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.351862 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.352008 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.352154 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.352298 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.352444 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.352603 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.352750 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.352903 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.353050 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.353213 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.353404 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.353569 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.353726 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.353875 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.354025 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.354180 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.354339 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.354490 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.354645 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.354819 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.354977 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.355137 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.355292 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.355437 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.355590 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.355736 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.355889 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.356042 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.356197 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.356349 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.356496 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.356658 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.356877 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.357591 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.357749 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.357907 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.358078 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.358256 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.358414 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.358575 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.358773 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.358920 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.359063 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.359219 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.359363 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.359516 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.359672 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.359817 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.359960 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.360110 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.360255 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.360412 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.360556 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.360699 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.360844 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.361035 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.361181 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.361337 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.361482 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.361633 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.361779 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.361929 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.362092 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.362092 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.362382 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.362525 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.362688 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.362859 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.363019 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.363165 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.363325 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.363508 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.363674 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.363825 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.363985 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.364143 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.364295 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.364444 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.364851 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.365009 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.365165 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.365314 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.365461 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.365610 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.365772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.365934 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.366086 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.366235 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.366390 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.366540 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.366739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.366920 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.367148 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.367301 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.367447 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.367591 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.367735 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.367912 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.368060 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.368231 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.368384 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.368534 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.368680 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.368838 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.368983 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.369136 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.369282 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.369427 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.369580 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.369724 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.369868 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.370018 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.370169 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.370320 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.370473 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.370625 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.370797 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.370944 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.371138 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.371288 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.371444 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.371599 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.371745 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.371895 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.372055 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.372214 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.372445 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.372616 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.372764 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.372917 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.373062 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.373208 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.373364 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.373541 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.373701 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.373854 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.374003 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.374164 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.374314 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.374479 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.374630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.374817 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.374963 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.375125 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.375269 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.375415 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.375558 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.375703 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.375880 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.375880 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.376166 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.376318 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.376469 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.376614 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.376766 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.376920 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.377072 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.377307 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.377466 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.377614 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.377758 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.377903 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.378067 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.378218 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.378402 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.378550 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.378742 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.378907 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.379057 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.379206 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.379362 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.379362 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.379656 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.379814 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.379971 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.380121 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.380270 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.380425 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.380584 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.380748 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.380748 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.381038 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.381233 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.381393 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.381544 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.381701 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.381863 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.382014 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.382169 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.382318 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.382487 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.382637 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.382852 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.382998 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.383143 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.383286 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.383430 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.383590 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.383790 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.383954 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.384100 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.384243 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.384394 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.384549 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.384694 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.384848 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.385000 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.385146 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.385290 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.385443 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.385588 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.385740 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.385885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.386030 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.386173 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.386331 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.386477 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.386622 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.386805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.386954 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.387123 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.387287 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.387500 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.387658 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.387805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.387951 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.388125 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.388276 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.388447 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.388744 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.388896 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.389190 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.389356 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.389506 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.389669 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.389820 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.389981 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.390131 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.390289 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.390439 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.390589 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.390589 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.390935 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.391093 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.391292 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.391438 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.391590 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.391737 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.391880 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.392034 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.392198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.392343 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.392494 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.392645 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.392792 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.392983 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.393150 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.393320 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.393485 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.393650 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.393811 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.393985 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.394151 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.394328 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.394501 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.394656 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.394857 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.395007 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.395181 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.395334 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.395481 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.395634 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.395790 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.395946 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.396099 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.396244 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.396389 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.396533 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.396756 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.396918 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.397080 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.397224 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.397368 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.397535 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.397771 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.397921 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.398067 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.398212 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.398357 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.398531 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.398740 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.398896 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.399061 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.399215 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.399361 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.399516 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.399662 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.399807 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.399951 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.400095 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.400239 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.400392 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.400538 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.400684 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.400840 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.400986 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.401141 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.401339 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.401493 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.401640 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.401792 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.401936 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.402097 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.402244 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.402244 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.402525 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.402691 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.402852 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.403011 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.403168 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.403313 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.403457 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.403602 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.404252 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.404456 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.404615 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.404769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.404915 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.405059 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.405203 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.405361 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.405506 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.405650 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.405794 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.405939 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.406091 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.406235 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.406386 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.406529 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.406694 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.406869 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.407026 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.407172 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.407320 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.407465 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.407609 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.407766 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.407988 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.408135 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.408287 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.408431 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.408575 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.408743 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.408905 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.409052 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.409204 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.409355 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.409500 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.409650 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.409809 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.409954 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.410099 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.410243 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.410386 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.410546 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.410736 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.410885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.411041 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.411192 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.411338 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.411529 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.411674 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.411817 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.411961 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.412105 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.412261 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.412417 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.412567 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.412719 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.412864 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.413008 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.413165 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.413321 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.413465 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.413609 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.413753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.413904 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.414061 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.414206 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.414359 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.414539 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.414743 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.414913 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.415073 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.415238 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.415390 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.415539 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.415700 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.415854 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.416016 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.416165 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.416322 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.416472 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.416621 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.416770 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.416932 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.417080 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.417235 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.417386 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.417607 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.417774 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.417925 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.418156 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.418317 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.418470 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.418621 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.418829 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.419002 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.419153 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.419309 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.420043 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.420196 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.420358 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.420516 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.420667 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.420817 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.420966 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.421115 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.421272 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.421422 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.421611 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.421759 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.421922 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.422088 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.422238 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.422387 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.422536 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.422754 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.422903 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.423062 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.423209 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.423354 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.423506 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.423651 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.423794 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.423954 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.424140 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.424295 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.424441 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.424601 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.424799 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.424961 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.425115 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.425260 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.425412 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.425570 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.425724 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.425877 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.426036 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.426182 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.426329 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.426473 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.426729 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.426883 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.427029 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.427176 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.427322 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.427322 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.427614 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.427614 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.427907 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.428055 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.428297 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.428447 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.428607 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.428761 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.428925 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.429104 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.429256 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.429416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.429568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.429730 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.429882 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.430048 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.430200 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.430361 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.430543 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.430753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.430906 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.431052 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.431221 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.431381 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.431575 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.431735 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.431881 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.431881 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.432162 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.432308 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.432461 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.432620 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.432766 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.432910 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.433062 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.433208 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.433353 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.433510 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.433665 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.433817 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.433968 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.434113 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.434267 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.434412 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.434556 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.434746 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.434939 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.435160 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.435339 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.435532 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.435786 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.435951 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.436103 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.436261 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.436421 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.436581 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.436731 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.436881 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.437031 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.437179 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.437404 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.437556 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.437556 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.437851 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.438000 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.438163 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.438363 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.438616 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.438814 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.438961 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.439121 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.439294 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.439443 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.439590 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.439734 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.439880 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.440023 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.440179 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.440325 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.440476 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.440623 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.440767 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.440912 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.441066 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.441224 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.441370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.441515 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.441697 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.441855 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.442000 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.442159 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.442317 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.442463 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.442613 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.442809 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.442960 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.443106 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.443259 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.443407 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.443553 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.443710 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.443857 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.444004 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.444150 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.444302 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.444450 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.444606 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.444755 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.444926 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.445122 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.445278 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.445438 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.445589 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.445739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.445889 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.446045 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.446197 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.446361 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.446512 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.446708 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.446880 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.447049 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.447206 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.447376 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.447523 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.447669 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.447815 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.447960 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.448106 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.448106 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.448405 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.448551 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.448780 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.448930 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.449087 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.449255 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.449425 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.449570 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.449724 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.449887 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.450051 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.450197 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.450348 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.450494 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.450661 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.450853 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.451023 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.451175 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.451175 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.451460 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.451460 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.451781 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.451781 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.452078 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.452234 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.452392 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.452543 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.452721 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.452871 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.453023 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.453173 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.453329 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.453478 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.453637 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.453799 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.453955 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.454107 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.454257 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.454413 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.454576 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.454576 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.454874 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.455033 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.455220 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.455220 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.455524 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.455670 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.455814 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.455960 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.456104 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.456262 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.456417 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.456417 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.456694 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.456840 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.456993 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.457151 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.457299 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.457451 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.457597 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.457750 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.457903 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.458068 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.458227 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.458376 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.458521 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.458845 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.459002 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.459166 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.459340 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.459511 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.459665 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.459823 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.460010 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.460159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.460300 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.460435 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.460573 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.460721 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.460871 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.461013 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.461151 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.461297 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.461457 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.461620 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.461848 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.462005 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.462156 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.462306 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.462466 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.462466 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.462815 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.462964 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.463123 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.463275 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.463432 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.463617 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.463781 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.463955 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.464138 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.464324 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.464509 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.464678 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.464852 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.465032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.465202 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.465397 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.465582 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.465770 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.465944 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.466146 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.466860 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.467038 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.467038 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.467508 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.467677 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.467849 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.468022 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.468213 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.468407 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.468591 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.468746 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.468918 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.469148 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.469307 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.469466 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.469622 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.469784 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.469949 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.469949 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.470280 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.470434 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.470588 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.470770 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.470922 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.471077 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.471228 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.471385 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.471530 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.471674 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.471818 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.472007 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.472155 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.472300 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.472446 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.472606 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.472759 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.472913 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.473070 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.473223 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.473384 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.473530 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.473683 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.473829 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.473972 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.474117 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.474269 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.474413 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.474580 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.474776 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.474924 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.475083 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.475240 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.475240 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.475530 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.475530 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.475816 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.475961 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.476115 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.476259 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.476420 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.476609 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.476764 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.476919 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.477073 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.477073 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.477336 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.477475 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.477613 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.477751 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.477889 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.478039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.478189 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.478344 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.478506 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.478691 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.478849 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.479027 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.479206 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.479449 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.479601 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.479747 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.479905 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.480080 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.480240 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.480400 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.480578 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.480756 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.480946 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.481120 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.481304 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.481479 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.481648 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.481823 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.482604 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.482801 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.482801 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.483146 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.483338 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.483515 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.483704 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.483881 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.484055 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.484055 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.484395 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.484574 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.485453 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.485608 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.485759 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.485907 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.486064 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.486211 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.486365 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.486527 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.486710 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.486873 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.487041 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.487190 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.487335 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.487488 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.487642 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.487786 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.487949 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.488096 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.488266 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.488456 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.488614 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.488770 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.488927 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.489081 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.489228 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.489396 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.489860 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.490017 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.490162 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.490307 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.490452 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.490596 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.490757 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.490920 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.491071 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.491217 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.491362 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.491513 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.491669 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.491669 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.491960 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.492146 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.492292 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.492437 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.492601 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.492777 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.492933 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.493088 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.493242 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.493387 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.493546 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.493692 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.493837 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.493990 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.494135 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.494287 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.494445 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.494591 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.494813 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.494978 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.495164 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.495334 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.495496 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.495643 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.495788 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.495940 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.496086 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.496230 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.496384 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.496530 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.496682 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.496833 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.496992 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.497159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.497310 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.497456 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.497636 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.497802 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.497957 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.497957 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.498313 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.498475 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.498651 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.498827 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.498985 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.499145 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.499301 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.499454 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.499600 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.499745 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.499745 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.500123 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.500123 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.500420 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.500566 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.500712 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.500867 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.501018 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.501164 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.501320 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.501320 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.501605 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.501762 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.501907 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.502052 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.502234 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.502234 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.502511 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.502686 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.502850 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.503005 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.503155 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.503300 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.503300 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.503595 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.503755 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.503902 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.504047 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.504201 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.504376 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.504551 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.504699 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.504851 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.505004 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.505178 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.505378 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.505535 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.505683 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.505828 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.505973 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.506127 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.506272 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.506416 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.506564 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.506802 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.506954 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.507118 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.507266 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.507431 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.507581 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.507728 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.507874 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.508032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.508179 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.508325 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.508470 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.508633 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.508822 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.508977 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.509127 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.509284 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.509435 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.509588 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.509753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.509904 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.510055 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.510296 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.510296 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.510587 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.510769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.510933 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.511079 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.511225 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.511378 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.511378 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.511673 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.511819 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.511982 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.512133 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.512325 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.512481 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.512627 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.512780 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.512936 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.513085 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.513272 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.513427 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.513573 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.513718 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.513864 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.514088 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.514243 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.514400 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.514400 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.514703 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.514863 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.515013 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.515172 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.515336 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.515523 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.515680 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.515830 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.515995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.516157 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.516307 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.516457 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.516606 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.516763 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.516913 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.517114 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.517273 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.517423 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.517655 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.517826 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.517987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.518146 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.518297 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.518297 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.518583 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.518820 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.518987 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.519136 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.519281 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.519426 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.519570 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.519713 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.519868 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.520014 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.520160 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.520318 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.520539 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.520695 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.520850 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.521001 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.521166 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.521315 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.521459 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.521613 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.521759 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.521902 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.522047 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.522190 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.522376 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.522533 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.522703 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.522863 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.523011 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.523162 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.523321 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.523478 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.523625 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.523781 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.523934 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.524081 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.524227 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.524383 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.524530 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.524676 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.524828 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.524828 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.525117 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.525263 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.525425 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.525612 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.525786 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.525936 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.526100 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.526252 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.526402 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.526551 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.526724 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.526873 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.527104 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.527263 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.527410 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.527557 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.527702 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.527856 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.528002 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.528146 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.528299 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.528444 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.528591 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.529260 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.529443 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.529592 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.529738 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.529883 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.530027 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.530187 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.530334 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.530334 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.530737 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.530892 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531057 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531215 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531378 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531538 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531701 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531701 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.531995 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.533159 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.534285 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:58:38.535437 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:58:38.671296 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO dbcounter [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Registered counter for database nova_api Oct 10 11:58:38.677226 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO dbcounter [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Registered counter for database nova_api Oct 10 11:58:38.692143 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_db.sqlalchemy.engines [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.697059 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_db.sqlalchemy.engines [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.698985 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writer thread running {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:38.704194 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writer thread running {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:38.755538 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.context [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4587e877-98cd-4f6e-b483-66663d295a9b(cell1) {{(pid=106223) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 11:58:38.759476 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:38.759936 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:38.760650 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.context [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4587e877-98cd-4f6e-b483-66663d295a9b(cell1) {{(pid=106224) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 11:58:38.761483 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:38.762228 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:38.762684 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:38.765094 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_concurrency.lockutils [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:38.765216 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:38.765569 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_concurrency.lockutils [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:38.767196 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO dbcounter [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Registered counter for database nova_cell0 Oct 10 11:58:38.767299 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_concurrency.lockutils [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:38.767880 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_concurrency.lockutils [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 11:58:38.768326 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_concurrency.lockutils [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 11:58:38.770412 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_concurrency.lockutils [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 11:58:38.771137 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO dbcounter [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Registered counter for database nova_cell1 Oct 10 11:58:38.772425 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO dbcounter [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Registered counter for database nova_cell0 Oct 10 11:58:38.776637 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO dbcounter [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Registered counter for database nova_cell1 Oct 10 11:58:38.778651 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_db.sqlalchemy.engines [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.781600 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_db.sqlalchemy.engines [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.784404 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_db.sqlalchemy.engines [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.785997 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_db.sqlalchemy.engines [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.787201 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writer thread running {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:38.788960 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writer thread running {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:38.791991 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writer thread running {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:38.793799 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writer thread running {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:38.931612 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO dbcounter [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Registered counter for database nova_cell0 Oct 10 11:58:38.939311 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO dbcounter [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Registered counter for database nova_cell0 Oct 10 11:58:38.940833 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_db.sqlalchemy.engines [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.945412 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writer thread running {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:38.948360 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG oslo_db.sqlalchemy.engines [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:58:38.953206 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writer thread running {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:58:39.392219 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: WARNING keystonemiddleware.auth_token [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:39.399555 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: WARNING keystonemiddleware.auth_token [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:39.481238 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: WARNING keystonemiddleware.auth_token [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:39.488931 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: WARNING keystonemiddleware.auth_token [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:39.735339 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: WARNING keystonemiddleware.auth_token [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:39.741670 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: WARNING keystonemiddleware.auth_token [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:39.747149 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eceb39a9c0 pid: 106223 (default app) Oct 10 11:58:39.750231 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 11:58:39.751461 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001923 Oct 10 11:58:39.751882 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Mon Oct 10 11:58:39 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 11:58:39.828658 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: WARNING keystonemiddleware.auth_token [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 11:58:39.834655 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: WARNING keystonemiddleware.auth_token [None req-a30d1014-16ef-4b38-aad3-37293bc5ff39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 11:58:39.840054 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eceb39a9c0 pid: 106224 (default app) Oct 10 12:00:06.788756 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:06.789681 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 10 12:00:06.790062 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:06.802550 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writing DB stats nova_api:SELECT=3 {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:06.803363 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writing DB stats nova_cell0:SELECT=3 {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:06.804224 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writing DB stats nova_cell1:SELECT=3 {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:06.806309 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:07.683220 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-04c8c62b-1e04-4bdc-862f-226a856913e7 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:07.715622 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-04c8c62b-1e04-4bdc-862f-226a856913e7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918138 Oct 10 12:00:07.716539 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 10 12:00:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:10.377079 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:10.378073 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-2e398370-d44f-4627-8fcc-04d0c847a6a0 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Oct 10 12:00:10.378652 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:10.839352 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-33adbafb-eb8f-4548-a790-8c2c872b22d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "id": "c1", "ram": 256, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:10.956093 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-33adbafb-eb8f-4548-a790-8c2c872b22d0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.571209 Oct 10 12:00:10.956704 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:00:10.970958 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_api:SELECT=3 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:10.971818 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_cell1:SELECT=3 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:10.973731 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_cell0:SELECT=3 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:10.974863 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:11.179535 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-3157232b-af98-4f57-8d2e-3c25e25a5221 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:11.314465 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-3157232b-af98-4f57-8d2e-3c25e25a5221 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348634 Oct 10 12:00:11.315079 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 10 12:00:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:13.964462 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-33adbafb-eb8f-4548-a790-8c2c872b22d0 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:13.965590 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-33adbafb-eb8f-4548-a790-8c2c872b22d0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Oct 10 12:00:13.966075 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:14.746779 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-e4f5093c-1b9a-4664-96bb-13e2cf351425 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:14.884532 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-e4f5093c-1b9a-4664-96bb-13e2cf351425 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.911623 Oct 10 12:00:14.885656 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:00:14.897722 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-ede59398-6c6b-4b60-995f-b2558f3a71ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:15.037153 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-ede59398-6c6b-4b60-995f-b2558f3a71ab admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143325 Oct 10 12:00:15.037881 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 10 12:00:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:17.691525 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-e4f5093c-1b9a-4664-96bb-13e2cf351425 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:17.692538 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-e4f5093c-1b9a-4664-96bb-13e2cf351425 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 10 12:00:17.692940 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:18.186054 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-0dc52738-80ed-47dc-aa16-dd36ae5c1dd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:18.260834 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-0dc52738-80ed-47dc-aa16-dd36ae5c1dd2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561297 Oct 10 12:00:18.262361 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:00:18.275236 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-72817ec5-564e-43c2-88bb-883862a94561 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:18.386736 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-72817ec5-564e-43c2-88bb-883862a94561 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115919 Oct 10 12:00:18.387244 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 10 12:00:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:21.190645 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-0dc52738-80ed-47dc-aa16-dd36ae5c1dd2 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:21.191700 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-0dc52738-80ed-47dc-aa16-dd36ae5c1dd2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 10 12:00:21.192084 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:21.709578 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-301ded56-0d90-410c-afab-1b33778800db admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "id": "d3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:21.818964 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-301ded56-0d90-410c-afab-1b33778800db admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.619823 Oct 10 12:00:21.827397 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:00:21.834070 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-be083c43-1b8b-44e8-b0f9-80f60b050071 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:21.934738 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-be083c43-1b8b-44e8-b0f9-80f60b050071 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105026 Oct 10 12:00:21.935432 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 10 12:00:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:24.877451 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-301ded56-0d90-410c-afab-1b33778800db admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:24.878511 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-301ded56-0d90-410c-afab-1b33778800db admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 10 12:00:24.878969 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:25.458786 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-1c194747-2f54-464a-aef3-1346824d89a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:25.545134 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-1c194747-2f54-464a-aef3-1346824d89a8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.658405 Oct 10 12:00:25.546148 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:00:25.559384 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-c4e728d2-00b4-4aaa-b7d7-b0505260c8fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:25.642937 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-c4e728d2-00b4-4aaa-b7d7-b0505260c8fb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087912 Oct 10 12:00:25.643731 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Mon Oct 10 12:00:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:28.335551 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-1c194747-2f54-464a-aef3-1346824d89a8 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:28.336645 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-1c194747-2f54-464a-aef3-1346824d89a8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Oct 10 12:00:28.337098 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:28.803365 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-ecc5bf05-afba-4218-81fe-6623fd26daac admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:28.827706 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-ecc5bf05-afba-4218-81fe-6623fd26daac admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483884 Oct 10 12:00:28.828458 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 10 12:00:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:00:31.676240 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-1c194747-2f54-464a-aef3-1346824d89a8 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:31.677366 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-1c194747-2f54-464a-aef3-1346824d89a8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Oct 10 12:00:31.677771 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:32.147961 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-56f35b65-fbcb-427f-9366-238452c902cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:32.229882 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-56f35b65-fbcb-427f-9366-238452c902cc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.545405 Oct 10 12:00:32.230446 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:00:32.243396 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-2587b79c-c56a-49af-94bb-78d44045162b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:32.349632 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-2587b79c-c56a-49af-94bb-78d44045162b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109746 Oct 10 12:00:32.350743 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 10 12:00:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:00:35.495064 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-56f35b65-fbcb-427f-9366-238452c902cc admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:35.496235 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-56f35b65-fbcb-427f-9366-238452c902cc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Oct 10 12:00:35.499584 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:00:35.951027 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-30db3ef1-6e43-4f73-99de-1bcb357f7178 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:36.284455 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-30db3ef1-6e43-4f73-99de-1bcb357f7178 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.778226 Oct 10 12:00:36.285002 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:00:36.299482 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-b780a8e5-6308-4b5d-833d-1ccae94a3292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:36.395994 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-b780a8e5-6308-4b5d-833d-1ccae94a3292 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100913 Oct 10 12:00:36.396563 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 10 12:00:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:39.801956 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-30db3ef1-6e43-4f73-99de-1bcb357f7178 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:39.802997 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-30db3ef1-6e43-4f73-99de-1bcb357f7178 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 10 12:00:39.803711 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:00:40.595480 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-6f9905eb-3bc4-45a7-9199-d80ea6ecae88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:40.702569 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-6f9905eb-3bc4-45a7-9199-d80ea6ecae88 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.891540 Oct 10 12:00:40.704511 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:00:40.718414 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-2a9808bd-bf48-4a76-a951-6fb55561093d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:40.723616 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:40.831838 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-2a9808bd-bf48-4a76-a951-6fb55561093d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117417 Oct 10 12:00:40.839986 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 10 12:00:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:43.607948 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-6f9905eb-3bc4-45a7-9199-d80ea6ecae88 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:43.608964 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-6f9905eb-3bc4-45a7-9199-d80ea6ecae88 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 10 12:00:43.609340 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:00:44.120559 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-8e082984-8230-42ed-951f-edb8c056e55c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "ram": 8192}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:44.246281 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-8e082984-8230-42ed-951f-edb8c056e55c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.629874 Oct 10 12:00:44.247548 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:00:44.261983 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-765dd9e2-21fb-4660-a076-e5ae5665060d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:44.273160 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:44.397479 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-765dd9e2-21fb-4660-a076-e5ae5665060d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139549 Oct 10 12:00:44.398293 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 10 12:00:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:00:47.525334 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-8e082984-8230-42ed-951f-edb8c056e55c admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:00:47.525334 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-8e082984-8230-42ed-951f-edb8c056e55c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Oct 10 12:00:47.527325 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:00:48.006106 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-b8421246-4933-4b90-91bc-d5c91016714e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:48.108203 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-b8421246-4933-4b90-91bc-d5c91016714e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.575327 Oct 10 12:00:48.108972 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Mon Oct 10 12:00:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:00:48.128043 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-6915b9c1-b670-4981-ad61-52f8808a6477 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:00:48.216678 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-6915b9c1-b670-4981-ad61-52f8808a6477 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095563 Oct 10 12:00:48.217270 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Mon Oct 10 12:00:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:01:04.949579 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-b8421246-4933-4b90-91bc-d5c91016714e admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:04.950590 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-b8421246-4933-4b90-91bc-d5c91016714e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 10 12:01:04.951038 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:01:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:04.962518 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:05.399089 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-1a0cbe0d-ecf8-4de1-a31a-229eae1825d8 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:05.417617 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-1a0cbe0d-ecf8-4de1-a31a-229eae1825d8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.460045 Oct 10 12:01:05.418142 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 10 12:01:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:06.796653 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-b8421246-4933-4b90-91bc-d5c91016714e admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:06.797647 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-b8421246-4933-4b90-91bc-d5c91016714e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 10 12:01:06.798039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:01:07.394492 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-0ad3e77e-14f0-4329-bc71-5c6bc041149f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:07.400313 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.wsgi [None req-0ad3e77e-14f0-4329-bc71-5c6bc041149f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-0ad3e77e-14f0-4329-bc71-5c6bc041149f admin admin] Request method failure captured: Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Accept: application/json Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Accept-Encoding: gzip, deflate Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Connection: keep-alive Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Content-Length: 0 Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Host: 10.222.0.46 Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Openstack-Api-Version: compute 2.92 Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Openstack-System-Scope: None Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: User-Agent: python-novaclient Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Auth-Token: gAAAAABjRAmC0JvhCcgADqffSr-a1UyWuaTsspdTNFVWU7NSxz6JjpYd2gEDl5SGyrnjsMaa_OVfTI-FYTR_HVG0x69OjrXYdNqWhooSBkSNQPtS6XMWyPQvt3bbrXcGfMEveLb5XCLXONcTd4OwxZCr92hFuzVX7gxOr5-ClALPShyy2V_j5Q0 Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Domain-Id: None Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Domain-Name: None Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Identity-Status: Confirmed Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Is-Admin-Project: True Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Domain-Id: default Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Domain-Name: Default Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Name: admin Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Role: admin,member,reader Oct 10 12:01:07.403597 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Roles: admin,member,reader Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec187f354d154dc98e045921aa4ca7fd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant: admin Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant-Name: admin Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User: admin Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Domain-Id: default Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Domain-Name: Default Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Id: 8cbbc9233ced43d487079e9479dc555c Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Name: admin Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: method: > Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: exception: Flavor 42 could not be found. Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: action_args: {'id': '42'} Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:07.405370 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:07.406416 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.407987 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-0ad3e77e-14f0-4329-bc71-5c6bc041149f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:07.409288 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-0ad3e77e-14f0-4329-bc71-5c6bc041149f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.440301 Oct 10 12:01:07.409288 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 10 12:01:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:07.415997 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-37d77981-46c0-4736-80cd-b23762c35e50 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:07.420180 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:07.439691 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-37d77981-46c0-4736-80cd-b23762c35e50 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028213 Oct 10 12:01:07.440270 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 10 12:01:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:07.455254 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-52b419a1-abf6-4c55-8d92-29af0d497c4b admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:07.486656 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-52b419a1-abf6-4c55-8d92-29af0d497c4b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.039268 Oct 10 12:01:07.487509 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 10 12:01:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:07.500370 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-0aa74f32-2a3b-45e5-98f6-b0cab9cd7cbb admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:07.506878 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.wsgi [None req-0aa74f32-2a3b-45e5-98f6-b0cab9cd7cbb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-0aa74f32-2a3b-45e5-98f6-b0cab9cd7cbb admin admin] Request method failure captured: Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Accept: application/json Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Accept-Encoding: gzip, deflate Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Connection: keep-alive Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Content-Length: 0 Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Host: 10.222.0.46 Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Openstack-Api-Version: compute 2.92 Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Openstack-System-Scope: None Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: User-Agent: python-novaclient Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Auth-Token: gAAAAABjRAmC0JvhCcgADqffSr-a1UyWuaTsspdTNFVWU7NSxz6JjpYd2gEDl5SGyrnjsMaa_OVfTI-FYTR_HVG0x69OjrXYdNqWhooSBkSNQPtS6XMWyPQvt3bbrXcGfMEveLb5XCLXONcTd4OwxZCr92hFuzVX7gxOr5-ClALPShyy2V_j5Q0 Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Domain-Id: None Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Domain-Name: None Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Identity-Status: Confirmed Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Is-Admin-Project: True Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Domain-Id: default Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Domain-Name: Default Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Name: admin Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Role: admin,member,reader Oct 10 12:01:07.510805 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Roles: admin,member,reader Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec187f354d154dc98e045921aa4ca7fd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant: admin Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant-Name: admin Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User: admin Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Domain-Id: default Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Domain-Name: Default Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Id: 8cbbc9233ced43d487079e9479dc555c Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Name: admin Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: method: > Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: exception: Flavor 42 could not be found. Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: action_args: {'id': '42'} Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:07.519824 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:07.520769 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:07.522024 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-0aa74f32-2a3b-45e5-98f6-b0cab9cd7cbb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:07.523271 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-0aa74f32-2a3b-45e5-98f6-b0cab9cd7cbb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.017205 Oct 10 12:01:07.523271 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 10 12:01:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:08.776359 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-52b419a1-abf6-4c55-8d92-29af0d497c4b admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:08.777677 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-52b419a1-abf6-4c55-8d92-29af0d497c4b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 10 12:01:08.778082 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:09.318535 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-19de0686-28f3-48a1-84a1-b0ca05b28bea admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:09.323543 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.wsgi [None req-19de0686-28f3-48a1-84a1-b0ca05b28bea admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-19de0686-28f3-48a1-84a1-b0ca05b28bea admin admin] Request method failure captured: Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Accept: application/json Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Accept-Encoding: gzip, deflate Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Connection: keep-alive Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Content-Length: 0 Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Host: 10.222.0.46 Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Openstack-Api-Version: compute 2.92 Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Openstack-System-Scope: None Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: User-Agent: python-novaclient Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Auth-Token: gAAAAABjRAmEHy7jKXpD9PMRWtCnU06DhADVv-UPXTrDtjkosfb0VOUNlsQZ5LiZ0JvaSWS6cqStACUSslP6Zd660ENokt8Dfke2z6WP8KkrJlfI-fAbUmhMHaK_xasp3EZX4gO2pM8Pjg1sndnbHK1-lbbwyrY0h2o0iSoI5cwZvJT_DoEQdVI Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Domain-Id: None Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Domain-Name: None Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Identity-Status: Confirmed Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Is-Admin-Project: True Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Domain-Id: default Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Domain-Name: Default Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Name: admin Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Role: admin,member,reader Oct 10 12:01:09.325039 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Roles: admin,member,reader Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec187f354d154dc98e045921aa4ca7fd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant: admin Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant-Name: admin Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User: admin Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Domain-Id: default Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Domain-Name: Default Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Id: 8cbbc9233ced43d487079e9479dc555c Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Name: admin Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: method: > Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: exception: Flavor 84 could not be found. Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: action_args: {'id': '84'} Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:09.326796 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:09.327866 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.329161 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-19de0686-28f3-48a1-84a1-b0ca05b28bea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:09.330400 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-19de0686-28f3-48a1-84a1-b0ca05b28bea admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.408830 Oct 10 12:01:09.330400 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 10 12:01:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:09.336988 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-4719d006-0eb7-4dbb-9947-18b9d9f93161 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:09.351667 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-4719d006-0eb7-4dbb-9947-18b9d9f93161 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018830 Oct 10 12:01:09.352866 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 10 12:01:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:09.362707 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-5b0558fa-53f6-492c-bb84-6ba9f011a72c admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:09.378229 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-5b0558fa-53f6-492c-bb84-6ba9f011a72c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019271 Oct 10 12:01:09.378806 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 10 12:01:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:09.388809 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-ae9e435e-9acc-4e0f-8d5b-c56e677a4ac2 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:09.393802 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.wsgi [None req-ae9e435e-9acc-4e0f-8d5b-c56e677a4ac2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-ae9e435e-9acc-4e0f-8d5b-c56e677a4ac2 admin admin] Request method failure captured: Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Accept: application/json Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Accept-Encoding: gzip, deflate Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Connection: keep-alive Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Content-Length: 0 Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Host: 10.222.0.46 Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Openstack-Api-Version: compute 2.92 Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Openstack-System-Scope: None Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: User-Agent: python-novaclient Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Auth-Token: gAAAAABjRAmEHy7jKXpD9PMRWtCnU06DhADVv-UPXTrDtjkosfb0VOUNlsQZ5LiZ0JvaSWS6cqStACUSslP6Zd660ENokt8Dfke2z6WP8KkrJlfI-fAbUmhMHaK_xasp3EZX4gO2pM8Pjg1sndnbHK1-lbbwyrY0h2o0iSoI5cwZvJT_DoEQdVI Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Domain-Id: None Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Domain-Name: None Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Identity-Status: Confirmed Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Is-Admin-Project: True Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Domain-Id: default Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Domain-Name: Default Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Name: admin Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Role: admin,member,reader Oct 10 12:01:09.395355 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Roles: admin,member,reader Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec187f354d154dc98e045921aa4ca7fd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant: admin Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant-Name: admin Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User: admin Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Domain-Id: default Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Domain-Name: Default Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Id: 8cbbc9233ced43d487079e9479dc555c Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Name: admin Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: method: > Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: exception: Flavor 84 could not be found. Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: action_args: {'id': '84'} Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:09.396846 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:09.397739 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:09.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-ae9e435e-9acc-4e0f-8d5b-c56e677a4ac2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:09.400990 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-ae9e435e-9acc-4e0f-8d5b-c56e677a4ac2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011509 Oct 10 12:01:09.400990 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Oct 10 12:01:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:10.650118 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-5b0558fa-53f6-492c-bb84-6ba9f011a72c admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:10.651169 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-5b0558fa-53f6-492c-bb84-6ba9f011a72c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 10 12:01:10.651568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:11.213467 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-1ebd4c06-f2f4-4eb5-a080-fab09ddac73c admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:11.220202 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.wsgi [None req-1ebd4c06-f2f4-4eb5-a080-fab09ddac73c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-1ebd4c06-f2f4-4eb5-a080-fab09ddac73c admin admin] Request method failure captured: Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Accept: application/json Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Accept-Encoding: gzip, deflate Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Connection: keep-alive Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Content-Length: 0 Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Host: 10.222.0.46 Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Openstack-Api-Version: compute 2.92 Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Openstack-System-Scope: None Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: User-Agent: python-novaclient Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Auth-Token: gAAAAABjRAmGZveN9fW2wLXtWeD5EgImHuR2lVdIW_P-ieG3uU3FXXVMJjhTBlFDuNvS968XFq3RP0OY8FB1C0pWVv5NoovwVol_xZLfCS0pnJyqoQhFbz0GnTKUI4tA4NEB3uXXGRw5kDtuO5U0jiuXbRtJ-S1Jj1Ybh3ADWKfsaTY1_oYigq8 Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Domain-Id: None Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Domain-Name: None Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Identity-Status: Confirmed Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Is-Admin-Project: True Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Domain-Id: default Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Domain-Name: Default Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Project-Name: admin Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Role: admin,member,reader Oct 10 12:01:11.221753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Roles: admin,member,reader Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec187f354d154dc98e045921aa4ca7fd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant: admin Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-Tenant-Name: admin Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User: admin Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Domain-Id: default Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Domain-Name: Default Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Id: 8cbbc9233ced43d487079e9479dc555c Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: X-User-Name: admin Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: method: > Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: exception: Flavor 451 could not be found. Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: action_args: {'id': '451'} Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:11.223319 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:11.224198 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.225630 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-1ebd4c06-f2f4-4eb5-a080-fab09ddac73c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:11.227494 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-1ebd4c06-f2f4-4eb5-a080-fab09ddac73c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.431771 Oct 10 12:01:11.227494 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 10 12:01:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:11.233947 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-5a4269b9-f8f5-44ee-b888-5ade499a5716 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:11.250537 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-5a4269b9-f8f5-44ee-b888-5ade499a5716 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020156 Oct 10 12:01:11.251127 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 10 12:01:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:11.261059 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:11.276923 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019373 Oct 10 12:01:11.277492 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Oct 10 12:01:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:01:11.287514 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-7efe8c8b-945e-4044-a82c-3a389f658644 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:11.293908 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.wsgi [None req-7efe8c8b-945e-4044-a82c-3a389f658644 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-7efe8c8b-945e-4044-a82c-3a389f658644 admin admin] Request method failure captured: Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Accept: application/json Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Accept-Encoding: gzip, deflate Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Connection: keep-alive Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Content-Length: 0 Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Host: 10.222.0.46 Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Openstack-Api-Version: compute 2.92 Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Openstack-System-Scope: None Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: User-Agent: python-novaclient Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Auth-Token: gAAAAABjRAmGZveN9fW2wLXtWeD5EgImHuR2lVdIW_P-ieG3uU3FXXVMJjhTBlFDuNvS968XFq3RP0OY8FB1C0pWVv5NoovwVol_xZLfCS0pnJyqoQhFbz0GnTKUI4tA4NEB3uXXGRw5kDtuO5U0jiuXbRtJ-S1Jj1Ybh3ADWKfsaTY1_oYigq8 Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Domain-Id: None Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Domain-Name: None Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Identity-Status: Confirmed Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Is-Admin-Project: True Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Domain-Id: default Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Domain-Name: Default Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Project-Name: admin Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Role: admin,member,reader Oct 10 12:01:11.295568 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Roles: admin,member,reader Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ec187f354d154dc98e045921aa4ca7fd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ec187f354d154dc98e045921aa4ca7fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant: admin Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant-Id: ec187f354d154dc98e045921aa4ca7fd Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-Tenant-Name: admin Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User: admin Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Domain-Id: default Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Domain-Name: Default Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Id: 8cbbc9233ced43d487079e9479dc555c Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: X-User-Name: admin Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: method: > Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: exception: Flavor 451 could not be found. Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: action_args: {'id': '451'} Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:01:11.298032 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:11.299885 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: ERROR nova.api.openstack.wsgi Oct 10 12:01:11.302251 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-7efe8c8b-945e-4044-a82c-3a389f658644 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:01:11.304408 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-7efe8c8b-945e-4044-a82c-3a389f658644 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013221 Oct 10 12:01:11.304408 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 10 12:01:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:12.563727 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:12.564773 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 10 12:01:12.565170 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:13.129054 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-6625cb3f-9dea-4fb4-9d32-761b6a392d20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:13.203948 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-6625cb3f-9dea-4fb4-9d32-761b6a392d20 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.499269 Oct 10 12:01:13.204518 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 10 12:01:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:01:14.500996 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:14.501999 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 10 12:01:14.502395 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:15.090040 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-7695a796-a4b7-4a7d-9e78-8358e6446b90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:15.186626 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-7695a796-a4b7-4a7d-9e78-8358e6446b90 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.544531 Oct 10 12:01:15.187229 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 10 12:01:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:01:16.495577 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:16.496730 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001812 Oct 10 12:01:16.497363 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:17.114300 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-bd027156-35da-46d0-926f-39723239a14a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:17.187176 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-bd027156-35da-46d0-926f-39723239a14a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.497483 Oct 10 12:01:17.213485 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 10 12:01:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:01:18.473909 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:18.474992 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 10 12:01:18.477373 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:01:19.062637 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-82968e1f-fa08-4544-8d68-5f607c884ff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:01:19.140662 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-82968e1f-fa08-4544-8d68-5f607c884ff0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.520282 Oct 10 12:01:19.141222 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Oct 10 12:01:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:01:20.416519 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:20.417551 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 10 12:01:20.417932 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:01:20.969835 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-a64110cf-981b-4d5a-bea3-425ce8477f1c admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:01:20.991210 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-a64110cf-981b-4d5a-bea3-425ce8477f1c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.434371 Oct 10 12:01:20.991753 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Mon Oct 10 12:01:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:18.649361 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:18.650376 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5e484d88-5970-43ed-8b98-7c3b708db54f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Oct 10 12:02:18.650802 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Mon Oct 10 12:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:02:18.661341 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:19.048631 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-95dcd186-a3e5-46bf-a14a-443568586b72 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:19.068859 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-95dcd186-a3e5-46bf-a14a-443568586b72 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411920 Oct 10 12:02:19.069327 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Mon Oct 10 12:02:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:02:19.090615 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG dbcounter [-] [106224] Writing DB stats nova_api:SELECT=14 {{(pid=106224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:19.094335 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-47555fb8-f8bc-4a8a-a8e8-e08df3e20813 admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:19.102376 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-47555fb8-f8bc-4a8a-a8e8-e08df3e20813 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013148 Oct 10 12:02:19.106716 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Mon Oct 10 12:02:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:19.114768 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-908a497f-3cf8-4012-a7f5-53ba208cfbe8 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:19.122034 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-908a497f-3cf8-4012-a7f5-53ba208cfbe8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011161 Oct 10 12:02:19.122547 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Mon Oct 10 12:02:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:19.134438 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:19.141579 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011218 Oct 10 12:02:19.142109 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Mon Oct 10 12:02:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:02:19.154085 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-5eaa7166-43ad-4bce-9389-e79491c69b73 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:02:19.161259 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-5eaa7166-43ad-4bce-9389-e79491c69b73 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010673 Oct 10 12:02:19.161766 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Mon Oct 10 12:02:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:05:39.107759 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:39.108753 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 10 12:05:39.109143 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:05:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:39.249477 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_api:SELECT=6 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:39.392483 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:39.397217 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.397719 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.398142 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.398887 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:39.399322 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:39.399738 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:39.431399 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-1c7321ee-4e90-4a7a-928a-a3e1d356a29b admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.183077 Oct 10 12:05:39.431952 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 10 12:05:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:05:40.518151 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:40.519188 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 10 12:05:40.519580 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:40.712902 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:40.716512 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.717061 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.717689 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.718457 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:40.719008 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:40.719487 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:40.739366 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-e4fd305a-ff5d-45ec-8360-982a0d81e6a5 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078628 Oct 10 12:05:40.739997 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 10 12:05:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:05:52.199643 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:52.200651 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 10 12:05:52.201046 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:52.347438 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_cell0:SELECT=4 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:52.348164 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_cell1:SELECT=4 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:52.348772 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG dbcounter [-] [106223] Writing DB stats nova_api:SELECT=8 {{(pid=106223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:52.396792 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:52.400918 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:52.401398 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:52.401828 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:52.402545 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:52.403026 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:52.403445 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:52.429595 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-3f07b0cb-bf0a-4b21-86c4-1ba3c138d50c admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086495 Oct 10 12:05:52.430084 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 10 12:05:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:05:53.511338 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: DEBUG nova.api.openstack.wsgi [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] Calling method '>' {{(pid=106224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:53.512368 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: INFO nova.api.openstack.requestlog [None req-5fab7bfa-4532-474f-a4ed-68295053231e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 10 12:05:53.512769 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: [pid: 106224|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Oct 10 12:05:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:05:53.702818 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG nova.api.openstack.wsgi [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] Calling method '>' {{(pid=106223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:05:53.706202 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:53.706720 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:53.707144 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:53.707844 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:05:53.708311 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:05:53.708725 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: DEBUG oslo_concurrency.lockutils [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:05:53.730487 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: INFO nova.api.openstack.requestlog [None req-40feec0a-d8a8-4b7d-8ca1-076264af5f39 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079534 Oct 10 12:05:53.730989 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: [pid: 106223|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Oct 10 12:05:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:06:52.409172 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: Mon Oct 10 12:06:52 2022 - graceful shutdown triggered... Oct 10 12:06:52.409304 dv-cinder-860209-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 10 12:06:52.410324 dv-cinder-860209-4-iscsi devstack@n-api.service[106223]: Gracefully killing worker 1 (pid: 106223)... Oct 10 12:06:52.410786 dv-cinder-860209-4-iscsi devstack@n-api.service[106224]: Gracefully killing worker 2 (pid: 106224)... Oct 10 12:06:53.411422 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: worker 1 buried after 1 seconds Oct 10 12:06:53.411422 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: worker 2 buried after 1 seconds Oct 10 12:06:53.411422 dv-cinder-860209-4-iscsi devstack@n-api.service[106222]: goodbye to uWSGI. Oct 10 12:06:53.413008 dv-cinder-860209-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 10 12:06:53.413567 dv-cinder-860209-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 10 12:06:53.416794 dv-cinder-860209-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 12:06:53.435776 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 12:06:53 2022] *** Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: nodename: dv-cinder-860209-4-iscsi Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: machine: x86_64 Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: clock source: unix Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: pcre jit disabled Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: detected number of CPU cores: 4 Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: current working directory: / Oct 10 12:06:53.437784 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: detected binary path: /usr/bin/uwsgi-core Oct 10 12:06:53.438553 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: your processes number limit is 47680 Oct 10 12:06:53.438553 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: your memory page size is 4096 bytes Oct 10 12:06:53.438553 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: detected max file descriptor number: 2048 Oct 10 12:06:53.438553 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: lock engine: pthread robust mutexes Oct 10 12:06:53.438553 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: thunder lock: enabled Oct 10 12:06:53.438553 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 12:06:53.438553 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 12:06:53.476705 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: Python main interpreter initialized at 0x562776a329c0 Oct 10 12:06:53.477061 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: python threads support enabled Oct 10 12:06:53.477187 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: your server socket listen backlog is limited to 100 connections Oct 10 12:06:53.477303 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: your mercy for graceful operations on workers is 90 seconds Oct 10 12:06:53.477726 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 12:06:53.477950 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: *** Operational MODE: preforking *** Oct 10 12:06:53.478913 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: *** uWSGI is running in multiple interpreter mode *** Oct 10 12:06:53.479043 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: spawned uWSGI master process (pid: 121282) Oct 10 12:06:53.479336 dv-cinder-860209-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 10 12:06:53.481178 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: spawned uWSGI worker 1 (pid: 121297, cores: 1) Oct 10 12:06:53.481677 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: spawned uWSGI worker 2 (pid: 121298, cores: 1) Oct 10 12:06:53.481959 dv-cinder-860209-4-iscsi devstack@n-api.service[121282]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 12:06:54.145147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 12:06:54.148803 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 12:06:55.323484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 12:06:55.323484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: from cryptography.utils import int_from_bytes Oct 10 12:06:55.324216 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 12:06:55.324216 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: from cryptography.utils import int_from_bytes Oct 10 12:06:55.366712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 12:06:55.366712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: from cryptography.utils import int_from_bytes Oct 10 12:06:55.367331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 12:06:55.367331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: from cryptography.utils import int_from_bytes Oct 10 12:06:57.734843 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 12:06:57.735400 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 12:06:57.735672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 12:06:57.735965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 12:06:57.736238 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 12:06:57.736626 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.736955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.737285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.737601 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.737939 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.738256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.738585 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.738934 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.739273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.739548 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.739872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.740375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-4-iscsi {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.740708 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.741024 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.741343 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.741670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.741981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.742313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.742636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.743180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.746721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.747381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.747381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.747381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-4-iscsi {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.747589 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.747946 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.748166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.750702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.750702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.750702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.750702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.750702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.750702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.750702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.751274 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.751274 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.751434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.751739 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.752412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.752412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.752669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.752945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.753255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.753511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.753825 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.754154 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.754480 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.754842 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.755098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.755356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.755685 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.756011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.756329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.756640 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.756952 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.757262 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.757573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.757885 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.758196 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.758506 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.758863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.759191 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.759736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.760053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.760375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.760794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.761051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.761361 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.761713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.762036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.762350 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.762729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.763029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.763343 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.763657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.763973 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.764292 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.764634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.764945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.765202 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.765509 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.765816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.766140 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.766450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.766783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.767098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.767406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.767735 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.768029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.768339 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.768650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.768958 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.769268 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.769577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.769894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.770202 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.770509 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.770867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.771196 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.771508 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.771820 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.772134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.772439 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.772764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.773077 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.773403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.773723 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.774031 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.774341 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.774743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.775534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.775847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.776173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.776486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.776800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.777119 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.777429 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.777740 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.778050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.778351 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.778688 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.778992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.779301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.779609 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.779917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.780247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.780573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.780893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.781201 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.781509 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.781837 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.782185 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.782523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.782901 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.783224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.783564 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.783905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.784229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.784547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.784866 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.785198 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.785530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.785826 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.786143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.786467 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.786818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.787483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.787803 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.788148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.788441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.788773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.789104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.789434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.789754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.790111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.790526 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.791458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.791792 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.792125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.792444 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.792760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.793075 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.793425 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.793744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.794063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.794383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.794736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.795046 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.795365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.795680 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.796000 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.796317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.796630 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.796981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.797310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.797635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.797959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.798279 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.798604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.798966 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.799285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.799600 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.799910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.800222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.800535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.800851 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.801158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.801491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.801828 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.802143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.802975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.802975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.803298 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.803440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.803732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.804044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.804365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.804679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.804989 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.805478 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.805651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.805916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.806291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.806601 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.806951 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.807259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.807579 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.807892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.808204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.808520 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.808847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.809163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.809477 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.809817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.810149 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.810465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.810821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.811153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.811474 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.811783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.812095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.812402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.812711 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.813019 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.813330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.813635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.813869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 12:06:57.814377 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.814530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 12:06:57.814713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.814713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.815024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 12:06:57.815179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.815330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 12:06:57.815473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.815641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 12:06:57.815794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.815938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.816079 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.816229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.816401 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.816401 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.816695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.816695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.816997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.816997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.817304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.817471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.818858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.818951 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.819095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.819261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819337 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.819414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.819571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.819710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819832 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860209-4-iscsi {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.819912 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.819992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.820107 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.820243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.820444 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.820568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.820750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.820899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.821087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.821218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.821391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.821558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.822228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.822413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.822557 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.822910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.823032 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.823215 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.823356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.823545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.823672 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.823890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.823991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.824224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.824342 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.824544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.824651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.824872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.824979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.825184 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.825363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.825505 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.825602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.825823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.825921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.826133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.826238 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.826444 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.826561 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860209-4-iscsi {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.826779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.826900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.827104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.827219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.827415 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.827522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.827736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.827948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.828051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.828259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.828476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.828729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.828909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.829049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.829248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.829343 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.829583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.829663 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.829901 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.829991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.830238 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.830319 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.830569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.830656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.830931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.831022 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.831255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.831337 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.831567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.831658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.831883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.831983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.832195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.832276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.832504 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.832592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.832814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.832924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.833132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.833232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.833387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.833476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.833704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.833811 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.834035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.834136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.834344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.834434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.834660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.834775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.834962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.835062 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.835220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.835309 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.835547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.835636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.835885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.835981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.836201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.836301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.836513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.836599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.836823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.836909 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.837136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.837230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.837989 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.838079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.838305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.838399 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.838635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.838794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.838971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.839050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.839314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.839428 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.839584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.839691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.839889 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.839986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.840238 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.840327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.840553 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.840652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.840866 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.841053 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.841187 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.841278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.841512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.841610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.841830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.841940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.842156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.842265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.842469 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.842568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.842814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.842909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.843138 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.843230 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.843466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.843571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.843768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.843879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.844095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.844194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.844404 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.844513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.844695 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.844784 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.845010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.845099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.845320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.845422 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.845575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.845665 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.845888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.845989 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.846221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.846306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.846534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.846619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.846873 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.846968 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.847198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.847284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.847508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.847785 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.847865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.848122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.848208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.848435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.848526 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.848784 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.848880 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.849064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.849144 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.849457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.849571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.849688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.849768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.850000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.850078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.850310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.850407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.850621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.850737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.850967 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.851279 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.851559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.851729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.851886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.852216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.852327 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.852488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.852743 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.852833 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.853122 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.853344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.853473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.853773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.853975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.854085 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.854378 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.854570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.854700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.855282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.855472 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.855601 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.855911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.856011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.856243 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.856517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.856614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.856852 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.857132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.857235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.857453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.857728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.857818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.858102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.858311 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.858449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.858806 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.858960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.859157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.859471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.859587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.859786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.860066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.860165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.860412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.860670 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.860770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.861023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.861337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.861581 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.861677 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.861943 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.862183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.862295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.862561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.862812 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.862917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.863193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.863403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.863499 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.863835 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.863978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.864143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.864419 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.864580 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.864754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.865033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.865172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.865341 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.865656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.865768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.865968 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.866264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.866352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.866577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.866874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.866977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.867214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.867483 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.867573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.867823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.868061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.868158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.868536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.868659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.868767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.869077 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.869264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.869406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.869722 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.869824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.870032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.870337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.870429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.870821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.870942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.871029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.871274 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.871528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 12:06:57.871633 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.871900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.872150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.872247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.872568 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.872774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.872865 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.873121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.873400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.873497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.873724 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.873999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.874103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.874330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.874618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.874736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.874961 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.875589 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.875707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.875800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.875889 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.875976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.876182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.876488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.876591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.876796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.877251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.877357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.877437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.877666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.877767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.878092 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.878259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.878405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.878750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.878867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.879077 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.879390 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.879482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.879703 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.880001 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.880114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.880319 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.880610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.880701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.881049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.881219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.881320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.881555 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.881823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.881913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.882182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.882414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.882512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.882829 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.883065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.883158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.883773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.883883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.884166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.884962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.885051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.885051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.885216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.885308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.885522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.885834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.885937 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.886153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.886435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.886536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.887594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.887704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.887789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.887884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.887976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.887976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.888137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.888224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.888381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.888774 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.888884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.889052 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.889273 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.889466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.889728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.889824 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.890085 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.890179 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.890450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.890652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.890823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.891043 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.891166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.891362 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.891541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.891814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.892027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.892119 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.892440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.892548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.892855 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.892960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.893073 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.893390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.893487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.893713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.893900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.894034 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.894347 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.894461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.894794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.894918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.895118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.895219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.895434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.895553 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.895755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.895857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.896066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.896165 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.896378 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.896482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.896696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.896794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.897027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.897117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.897340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.897439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.897743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.897847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.897963 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.898062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.898292 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.898383 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.898605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.898782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.898958 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.899056 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.899275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.899372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.899599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.899688 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.900455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.900575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.900802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.900951 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.901142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.901275 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.901464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.901591 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.901814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.901904 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.902135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.902232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.902462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.902556 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.902810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.903522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.903622 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.903719 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.903810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.903906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.903989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904069 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904246 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904784 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.904993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.905083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.905310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.905414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.905640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.905737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.905959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.906067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.906272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.906361 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.906600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.906717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.906950 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.907047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.907272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.907362 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.907593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.907690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.907913 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.908023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.908247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.908345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.908572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.908679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.908905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.909013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.909199 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.909510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.909602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.909838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.909928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.910152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.910243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.910470 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.910568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.910812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.910906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.911114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.911883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.911969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.912978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.913082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.913309 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.913402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.913625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.913714 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.913935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.914021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.914247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.914334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.914595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.914847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.914940 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.915012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.915189 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.915271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.916712 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.916855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.916953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917119 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917303 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.917844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918192 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918539 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.918725 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.920891 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.920996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.920996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921237 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921237 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921478 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921733 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.921918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922508 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.922969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923144 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923585 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923761 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.923935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.924028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.924149 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.924344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.924456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.924667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.924789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.924991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.925083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.925310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.925412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.925628 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.925737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.925945 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.926046 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.926263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.926365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.926595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.926719 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.926936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.927023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.927260 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.927384 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.927577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.927670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.927894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.927984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.928212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.928314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.928529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.928629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.928839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.928929 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.929155 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.929275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.929480 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.929592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.929815 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.930053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.930146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.930384 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.930486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.930720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.930829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.931039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.931170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.931386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.931486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.931707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.931821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.932021 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.932123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.932333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.932423 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.932645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.932788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.932961 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.933059 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.933276 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.933375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.933606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.933711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.933930 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.934035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.934261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.934363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.934581 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.934719 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943480 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943662 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943752 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.943927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944333 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944408 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.944976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945115 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945290 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945290 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945870 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.945941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946267 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.946622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947328 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947328 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947805 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.947978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948060 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948311 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948501 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948665 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.948919 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949460 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949653 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.949969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950362 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950608 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950865 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.950973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951370 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951881 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.951963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952168 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952323 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952501 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952755 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.952942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953207 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.953868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.954076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.954176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.954382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.954476 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.954726 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.954838 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.955042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.955145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.955354 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.955446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.955666 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.955766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.955985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.956076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.956294 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.956394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.956604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.956703 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.956915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.957007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.957225 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.957319 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.957541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.957633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.957850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.957950 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.958258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.958358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.958567 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.958659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.958905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.958997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.959242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.959356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.959560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.959652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.959866 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.959964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.960177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.960276 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.960490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.960582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.960797 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.960911 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.961108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.961221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.961416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.961515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.961729 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.961828 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.962051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.962395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.963045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.963253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.963347 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.963571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.963664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.963892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.964112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.964216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.964457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.964549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.964787 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.964880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.965125 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.965211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.965439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.965532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.965760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.965859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.966074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.966166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.966386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.966489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.966731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.966828 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.967043 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.967134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.967360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.967460 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.967673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.967765 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.967987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.968085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.968298 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.968404 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.968608 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.968708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.968922 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.969016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.969237 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.969343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.969550 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.969643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.969861 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.969954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.970173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.970279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.970486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.970586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.971331 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976304 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976493 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976580 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976861 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.976953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977223 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977498 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.977894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978275 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.978948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979365 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979461 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.979726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980080 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980257 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.980932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981409 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.981928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982151 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.982952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983034 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983198 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983289 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.983930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.984062 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.984263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.984375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.984578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.984679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.984944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.985050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.985215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.985322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.985533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.985647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.985847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.985939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.986155 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.986249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.986468 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.986569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.986800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.986895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.987106 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.987210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.987410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.987513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.987716 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.987841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.988018 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.988120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.988353 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.988455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.988686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.988776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.989000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.989102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.989324 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.989425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.989639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.989734 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.989952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.990042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.990263 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.990355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.990575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.990681 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.990921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.991028 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.991238 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.991340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.991550 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.991684 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.991891 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.992012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.992217 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.992318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.992519 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.992620 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.992836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.992940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.993151 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.993244 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.993469 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.993607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.993803 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.993939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.994135 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.994253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.994464 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.994704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.994813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.995031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.995124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.995353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.995446 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.995678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.995794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.995993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.996093 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.996309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.996402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.996632 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.996739 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.996955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.997047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.997270 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.997369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.997581 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.997683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.997894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.997985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.998204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.998295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.998522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.998616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.998857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.998963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.999174 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.999297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.999493 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.999621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.999812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:57.999936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.000141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.000370 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.000467 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.000695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.000786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.001017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.001108 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.001352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.001445 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.001687 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.001779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.002025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.002118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.002343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.002436 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.002698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.002804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.003008 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.003108 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.003318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.003422 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.003628 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.003727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.003875 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 12:06:58.003967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.004281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.004596 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.004932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.005266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.005591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.005929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.006357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.006710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.007043 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.007380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.007717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.008034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.008352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.008672 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.008991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.009825 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.010161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.010505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.010827 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.011150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.011469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.011785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.012102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.012437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.012754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.013087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.013410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.013741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.014073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.014388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.014744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.015066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.015379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.015694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.016006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.016361 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.016677 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.017004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.017343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.017685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.018007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.018702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.019047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.019374 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.019692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.020020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.020351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.020661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.020975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.021294 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.021606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.021919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.022232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.022548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.022887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.023200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.023510 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.023841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.024154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.024486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.024803 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.025683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.025998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.026309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.026661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.026998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.027696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.028018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.028354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.028679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.029002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.029329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.029654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.029977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.030301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.030647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.030976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.031302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.031626 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.031952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.032520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.032858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.033180 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.033500 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.033822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.034145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.034546 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.034810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.035133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.035455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.035823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.036108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.036443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.036785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.037129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.037463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.037789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.038168 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.038438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.039106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.039229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.039457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.039783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.040105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.040426 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.040772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.041090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.041477 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.041957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.042058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.042347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.042689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.043014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.043349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.043698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.044021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.044348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.044671 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.044994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.045534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.045858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.046202 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.046615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.046917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.047246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.047582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.047921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.048235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.048552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.048875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.049193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.049508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.049843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.050164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.050477 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.050847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.051141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.051686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.052047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.052373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.052709 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.053045 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.053373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.053690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.054026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.054344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.054660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.055015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.055338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.055653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.055967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.056858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.056858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.057058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.057237 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.057556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.057894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.058210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.058546 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.058875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.059199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.059514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.059829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.060145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.060458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.060780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.061095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.061505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.061819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.062140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.062498 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.062843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.063429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.063770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.064086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.064400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.064729 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.065048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.065315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO dbcounter [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Registered counter for database nova_api Oct 10 12:06:58.065413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.065686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.066018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.066358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.066698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.067256 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.067604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.067933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.068277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.068618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.068936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.069252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.069571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.069903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.070221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.070540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.070884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.071205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.071523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.072361 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.072679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.072995 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.073311 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.073626 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.073944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.074259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.074576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.074918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.075242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.075591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.075918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.076244 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.076567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.076891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.077213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.077531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.077848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.078169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.078497 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.078862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.079185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.079501 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.079936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.080257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.080585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.080913 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.081633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.081748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.082064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.082382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.082725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.083046 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.083383 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.083733 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.084073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.084409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.084724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.085038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.085351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.085665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.085991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.086125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_db.sqlalchemy.engines [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.086538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.086638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.087067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.087393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.088116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.088431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.088746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.089063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.089380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.089690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.090002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.090315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.090627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.090977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.091385 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.091599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.091908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.092221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.092543 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.092841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.093149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.093410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writer thread running {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.093516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.093817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.094139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.094470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.094817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.095149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.095465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.095795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.096123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.096452 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.096766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.097106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.097424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.097741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.098066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.098385 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.098721 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.099043 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.099397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.099732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.100045 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.100377 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.100702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.101029 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.101351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.101668 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.102004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.102323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.102642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.103003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.103324 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.103645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.103969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.104285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.104605 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.105181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.105582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.105839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.106175 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.106495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.106865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.107200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.107555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.107874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.108232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.108568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.108890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.109211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.109524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 12:06:58.109773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 12:06:58.149661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.context [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4587e877-98cd-4f6e-b483-66663d295a9b(cell1) {{(pid=121298) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 12:06:58.154218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:58.154711 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:58.156309 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:58.157053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:58.157511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:58.159513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:58.161497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO dbcounter [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Registered counter for database nova_cell0 Oct 10 12:06:58.165620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO dbcounter [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Registered counter for database nova_cell1 Oct 10 12:06:58.172169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO dbcounter [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Registered counter for database nova_api Oct 10 12:06:58.173193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_db.sqlalchemy.engines [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.175293 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_db.sqlalchemy.engines [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.182943 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writer thread running {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.184257 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writer thread running {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.193105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.200966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writer thread running {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.257503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.context [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4587e877-98cd-4f6e-b483-66663d295a9b(cell1) {{(pid=121297) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 12:06:58.262275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:58.262782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:58.264388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:58.265118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:06:58.265592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:06:58.267673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:06:58.269698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO dbcounter [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Registered counter for database nova_cell0 Oct 10 12:06:58.274459 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO dbcounter [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Registered counter for database nova_cell1 Oct 10 12:06:58.282153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.284502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.290305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writer thread running {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.291652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writer thread running {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.331616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO dbcounter [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Registered counter for database nova_cell0 Oct 10 12:06:58.338353 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_db.sqlalchemy.engines [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.342893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writer thread running {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.439263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO dbcounter [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Registered counter for database nova_cell0 Oct 10 12:06:58.446567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_db.sqlalchemy.engines [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 12:06:58.452527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writer thread running {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 12:06:58.661059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: WARNING keystonemiddleware.auth_token [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 12:06:58.668988 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: WARNING keystonemiddleware.auth_token [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 12:06:58.775815 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: WARNING keystonemiddleware.auth_token [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 12:06:58.783259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: WARNING keystonemiddleware.auth_token [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 12:06:59.012493 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: WARNING keystonemiddleware.auth_token [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 12:06:59.019982 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: WARNING keystonemiddleware.auth_token [None req-5cdd0e9c-ad40-447c-bdcb-8d069cc46f0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 12:06:59.026024 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562776a329c0 pid: 121298 (default app) Oct 10 12:06:59.132931 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: WARNING keystonemiddleware.auth_token [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 12:06:59.139519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: WARNING keystonemiddleware.auth_token [None req-4fa42185-21d7-4588-a917-0b0981ef33d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 12:06:59.144777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562776a329c0 pid: 121297 (default app) Oct 10 12:07:35.774868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=3 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:35.775787 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=3 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:35.777148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=3 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:35.778589 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=3 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:37.243877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-45be1d24-05be-4891-96be-d56cb0282771 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Action: 'create', calling method: .version_select at 0x7f6d139644c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-479564393", "metadata": {"Type": "work"}}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:37.429423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:37.431796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:37.432989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:37.434003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:39.011057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8212e082-b2e7-4f8d-b7eb-9020473c8191 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Action: 'create', calling method: .version_select at 0x7f6d139654c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1671204204", "metadata": {"Type": "work"}}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8212e082-b2e7-4f8d-b7eb-9020473c8191 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Request method failure captured: Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 122 Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsJCQAK8qSSG7G8_FY866jRTjqsOStqVWkmD5Eb5_SO1dPfz2c7fVy96dTEm-aAgxRUaW9hpGzCUdFstJc-0iZh473D-DZhHzOzAI--ZmKP99cy-YYM35E1oWvQVGpUOmDWhuW8k31fA0BcmvJKSYOaJJ9R-xRIOotHFdUbvJYoCnA Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:07:39.022359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0f034495ee414357a60eb94a0328a037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0f034495ee414357a60eb94a0328a037", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fa9503bf665b42b3a5633eb6e0075f7f Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1671204204", "metadata": {"Type": "work"}}} Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:07:39.023816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1671204204', 'metadata': {'Type': 'work'}}}} Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise error Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi '#$%' Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:39.325412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 12:07:39.329416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8212e082-b2e7-4f8d-b7eb-9020473c8191 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8212e082-b2e7-4f8d-b7eb-9020473c8191 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.601656 Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 10 12:07:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1605 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ea433726-2863-48e9-9c35-640fb7ffe337 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Action: 'create', calling method: .version_select at 0x7f6d13965dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1819948973", "metadata": {"Type": "work"}}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ea433726-2863-48e9-9c35-640fb7ffe337 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Request method failure captured: Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 12:07:39.335404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 120 Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsJCQAK8qSSG7G8_FY866jRTjqsOStqVWkmD5Eb5_SO1dPfz2c7fVy96dTEm-aAgxRUaW9hpGzCUdFstJc-0iZh473D-DZhHzOzAI--ZmKP99cy-YYM35E1oWvQVGpUOmDWhuW8k31fA0BcmvJKSYOaJJ9R-xRIOotHFdUbvJYoCnA Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:07:39.339761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0f034495ee414357a60eb94a0328a037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0f034495ee414357a60eb94a0328a037", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fa9503bf665b42b3a5633eb6e0075f7f Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1819948973", "metadata": {"Type": "work"}}} Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1819948973', 'metadata': {'Type': 'work'}}}} Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise error Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi '0' Oct 10 12:07:39.343786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.362564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ea433726-2863-48e9-9c35-640fb7ffe337 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ea433726-2863-48e9-9c35-640fb7ffe337 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024182 Oct 10 12:07:39.368967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 2/2] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 10 12:07:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b4e2d969-bac0-419e-9df1-e3623f82464d tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Action: 'create', calling method: .version_select at 0x7f6d138201f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1531340515", "metadata": {"Type": "work"}}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b4e2d969-bac0-419e-9df1-e3623f82464d tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Request method failure captured: Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 119 Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsJCQAK8qSSG7G8_FY866jRTjqsOStqVWkmD5Eb5_SO1dPfz2c7fVy96dTEm-aAgxRUaW9hpGzCUdFstJc-0iZh473D-DZhHzOzAI--ZmKP99cy-YYM35E1oWvQVGpUOmDWhuW8k31fA0BcmvJKSYOaJJ9R-xRIOotHFdUbvJYoCnA Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:07:39.371658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0f034495ee414357a60eb94a0328a037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0f034495ee414357a60eb94a0328a037", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fa9503bf665b42b3a5633eb6e0075f7f Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1531340515", "metadata": {"Type": "work"}}} Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:07:39.376513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1531340515', 'metadata': {'Type': 'work'}}}} Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise error Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi '' Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:39.377938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 12:07:39.381166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 12:07:39.385421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 12:07:39.385421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.385421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b4e2d969-bac0-419e-9df1-e3623f82464d tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:39.385421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b4e2d969-bac0-419e-9df1-e3623f82464d tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019091 Oct 10 12:07:39.385421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 3/3] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 10 12:07:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:07:39.385421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c31e775c-1835-4b9f-a6f5-dc8a7c14f2ce tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Calling method '.version_select at 0x7f6d13820c10>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:39.866308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-c31e775c-1835-4b9f-a6f5-dc8a7c14f2ce tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] HTTP exception thrown: Volume tempest-invalid-921924172 could not be found. Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c31e775c-1835-4b9f-a6f5-dc8a7c14f2ce tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Request method failure captured: Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-921924172 HTTP/1.1 Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsJCQAK8qSSG7G8_FY866jRTjqsOStqVWkmD5Eb5_SO1dPfz2c7fVy96dTEm-aAgxRUaW9hpGzCUdFstJc-0iZh473D-DZhHzOzAI--ZmKP99cy-YYM35E1oWvQVGpUOmDWhuW8k31fA0BcmvJKSYOaJJ9R-xRIOotHFdUbvJYoCnA Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:07:39.875645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0f034495ee414357a60eb94a0328a037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0f034495ee414357a60eb94a0328a037", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fa9503bf665b42b3a5633eb6e0075f7f Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Volume tempest-invalid-921924172 could not be found. Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'tempest-invalid-921924172'} Oct 10 12:07:39.877576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-921924172 could not be found. (HTTP 404) (Request-ID: req-34d78f46-7c02-4144-bcc8-27a6be377c3e) Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.879735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:07:39.882235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-921924172 could not be found. Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:39.885816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-921924172 could not be found. Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-921924172 could not be found. Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c31e775c-1835-4b9f-a6f5-dc8a7c14f2ce tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Returning 404 to user: Volume tempest-invalid-921924172 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:39.890170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c31e775c-1835-4b9f-a6f5-dc8a7c14f2ce tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-921924172" status: 404 len: 98 microversion: 2.1 time: 0.788927 Oct 10 12:07:39.896157 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1215 bytes} [Mon Oct 10 12:07:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-921924172 => generated 98 bytes in 803 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 12:07:39.919501 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d15f8730-2cdc-49ea-9f7f-80f151602d05 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021604 Oct 10 12:07:39.931145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1140 bytes} [Mon Oct 10 12:07:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 12:07:39.966295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-356226cf-83c2-4f6e-8856-f0506a9e17b8 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024861 Oct 10 12:07:39.973972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1137 bytes} [Mon Oct 10 12:07:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 12:07:40.007095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-64aa4c83-164e-4225-ad2b-7a3509d3b408 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Calling method '.version_select at 0x7f6d13755430>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:40.052301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-45be1d24-05be-4891-96be-d56cb0282771 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.287680 Oct 10 12:07:40.053526 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 1/7] 10.222.0.46 () {60 vars in 1156 bytes} [Mon Oct 10 12:07:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4291 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 10 12:07:40.076992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d6c86490-20e1-4fe4-a444-10bd043db645 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Calling method '.version_select at 0x7f6d138393a0>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:40.123428 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-64aa4c83-164e-4225-ad2b-7a3509d3b408 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] HTTP exception thrown: Volume 57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 could not be found. Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-64aa4c83-164e-4225-ad2b-7a3509d3b408 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Request method failure captured: Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/os-volumes/57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 HTTP/1.1 Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsJCQAK8qSSG7G8_FY866jRTjqsOStqVWkmD5Eb5_SO1dPfz2c7fVy96dTEm-aAgxRUaW9hpGzCUdFstJc-0iZh473D-DZhHzOzAI--ZmKP99cy-YYM35E1oWvQVGpUOmDWhuW8k31fA0BcmvJKSYOaJJ9R-xRIOotHFdUbvJYoCnA Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:07:40.128552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0f034495ee414357a60eb94a0328a037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0f034495ee414357a60eb94a0328a037", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fa9503bf665b42b3a5633eb6e0075f7f Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Volume 57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 could not be found. Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '57aaddec-de18-4f84-9a4a-c1f51d3d8ba7'} Oct 10 12:07:40.131253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 could not be found. (HTTP 404) (Request-ID: req-38bebbee-71c8-40f6-84d8-862269e3473c) Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:40.132547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:07:40.136836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 could not be found. Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 12:07:40.142023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 could not be found. Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 could not be found. Oct 10 12:07:40.146055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.151986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-64aa4c83-164e-4225-ad2b-7a3509d3b408 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Returning 404 to user: Volume 57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:40.156177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-64aa4c83-164e-4225-ad2b-7a3509d3b408 tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/57aaddec-de18-4f84-9a4a-c1f51d3d8ba7" status: 404 len: 109 microversion: 2.1 time: 0.175908 Oct 10 12:07:40.159837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 7/8] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:07:39 2022] DELETE /compute/v2.1/os-volumes/57aaddec-de18-4f84-9a4a-c1f51d3d8ba7 => generated 109 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:40.191868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e06507ad-8521-433d-930c-04c6f6936b9c tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Calling method '.version_select at 0x7f6d13755160>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:40.215853 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d6c86490-20e1-4fe4-a444-10bd043db645 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85" status: 200 len: 352 microversion: 2.1 time: 0.140337 Oct 10 12:07:40.215853 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 2/9] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:40 2022] GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:07:40.281266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-e06507ad-8521-433d-930c-04c6f6936b9c tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] HTTP exception thrown: Volume 6928c15a-cbf1-42bf-9a75-fb01eeb7e754 could not be found. Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e06507ad-8521-433d-930c-04c6f6936b9c tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Request method failure captured: Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/os-volumes/6928c15a-cbf1-42bf-9a75-fb01eeb7e754 HTTP/1.1 Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsJCQAK8qSSG7G8_FY866jRTjqsOStqVWkmD5Eb5_SO1dPfz2c7fVy96dTEm-aAgxRUaW9hpGzCUdFstJc-0iZh473D-DZhHzOzAI--ZmKP99cy-YYM35E1oWvQVGpUOmDWhuW8k31fA0BcmvJKSYOaJJ9R-xRIOotHFdUbvJYoCnA Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:07:40.291889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0f034495ee414357a60eb94a0328a037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0f034495ee414357a60eb94a0328a037", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0f034495ee414357a60eb94a0328a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 0f034495ee414357a60eb94a0328a037 Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesNegativeTest-2075840562 Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fa9503bf665b42b3a5633eb6e0075f7f Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesNegativeTest-2075840562-project Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Volume 6928c15a-cbf1-42bf-9a75-fb01eeb7e754 could not be found. Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '6928c15a-cbf1-42bf-9a75-fb01eeb7e754'} Oct 10 12:07:40.296689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6928c15a-cbf1-42bf-9a75-fb01eeb7e754 could not be found. (HTTP 404) (Request-ID: req-fe000ebc-7b33-4ad7-8a6f-37cf260dedb2) Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:40.297969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:40.299115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6928c15a-cbf1-42bf-9a75-fb01eeb7e754 could not be found. Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 12:07:40.299924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6928c15a-cbf1-42bf-9a75-fb01eeb7e754 could not be found. Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6928c15a-cbf1-42bf-9a75-fb01eeb7e754 could not be found. Oct 10 12:07:40.300738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:40.306727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e06507ad-8521-433d-930c-04c6f6936b9c tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] Returning 404 to user: Volume 6928c15a-cbf1-42bf-9a75-fb01eeb7e754 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:40.308266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e06507ad-8521-433d-930c-04c6f6936b9c tempest-VolumesNegativeTest-2075840562 tempest-VolumesNegativeTest-2075840562-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6928c15a-cbf1-42bf-9a75-fb01eeb7e754" status: 404 len: 109 microversion: 2.1 time: 0.139160 Oct 10 12:07:40.308987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 8/10] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:40 2022] GET /compute/v2.1/os-volumes/6928c15a-cbf1-42bf-9a75-fb01eeb7e754 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:41.233722 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d5c5fb65-09bb-4959-a2b0-58e0276b056b tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Calling method '.version_select at 0x7f6d13839a60>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:41.358273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d5c5fb65-09bb-4959-a2b0-58e0276b056b tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85" status: 200 len: 352 microversion: 2.1 time: 0.130260 Oct 10 12:07:41.359494 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 3/11] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:41 2022] GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:42.387096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-055c6450-1fb1-4c5d-a18f-de2a4452c2a3 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Calling method '.version_select at 0x7f6d13820f70>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.519876 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-055c6450-1fb1-4c5d-a18f-de2a4452c2a3 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85" status: 200 len: 353 microversion: 2.1 time: 0.146149 Oct 10 12:07:42.520986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 9/12] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:42.574450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-22fda773-1935-4705-a215-f37ee97aba3c tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Calling method '.version_select at 0x7f6d1384a160>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:42.749418 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-22fda773-1935-4705-a215-f37ee97aba3c tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85" status: 200 len: 353 microversion: 2.1 time: 0.218667 Oct 10 12:07:42.767639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 4/13] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:42 2022] GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 => generated 353 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:42.781496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-35242e45-5db3-426e-b802-65d6fb6c9596 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Calling method '.version_select at 0x7f6d13755820>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:43.158015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-35242e45-5db3-426e-b802-65d6fb6c9596 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85" status: 202 len: 0 microversion: 2.1 time: 0.382482 Oct 10 12:07:43.164666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 10/14] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:07:42 2022] DELETE /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:07:43.183796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-dff88352-5905-4661-ab16-479056e3f545 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Calling method '.version_select at 0x7f6d13839b80>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:43.305161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-dff88352-5905-4661-ab16-479056e3f545 tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85" status: 200 len: 352 microversion: 2.1 time: 0.135587 Oct 10 12:07:43.306217 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 5/15] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:43 2022] GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:44.320638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5283d199-5e16-4382-ad32-e383636078ab tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Calling method '.version_select at 0x7f6d13755310>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:07:44.352176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-5283d199-5e16-4382-ad32-e383636078ab tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] HTTP exception thrown: Volume 0bbd3aa0-103c-478c-95a2-33c21be83d85 could not be found. Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5283d199-5e16-4382-ad32-e383636078ab tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Request method failure captured: Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 HTTP/1.1 Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsHUe3MdCUmPbs0opZ2JJkqIpiw4rR-xzom9kHCQQOAdHe5_5BKiBhG41zesSvkJDvGFBAa1uVItE04T88Zk5h6EL7kQ2-rBUgHOqw-Hgu00qJnA6iyheZTKesqt5UvMzu36KqrIQM0snXBRgDplONXkpiX-wYAVrOgfeYYdXCl1hE Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: b3c137fcc1464218b989ce343e84cd22 Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesGetTestJSON-1068734283 Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:07:44.356085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3c137fcc1464218b989ce343e84cd22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3c137fcc1464218b989ce343e84cd22", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3c137fcc1464218b989ce343e84cd22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3c137fcc1464218b989ce343e84cd22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesGetTestJSON-1068734283 Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: b3c137fcc1464218b989ce343e84cd22 Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesGetTestJSON-1068734283 Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesGetTestJSON-1068734283-project Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: d30a538ba96147718bbdcb6bfa07a934 Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesGetTestJSON-1068734283-project Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Volume 0bbd3aa0-103c-478c-95a2-33c21be83d85 could not be found. Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '0bbd3aa0-103c-478c-95a2-33c21be83d85'} Oct 10 12:07:44.357249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bbd3aa0-103c-478c-95a2-33c21be83d85 could not be found. (HTTP 404) (Request-ID: req-6436424e-d965-4d74-93e8-01f9b46c0a20) Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:44.357952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:07:44.359086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bbd3aa0-103c-478c-95a2-33c21be83d85 could not be found. Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 12:07:44.359979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bbd3aa0-103c-478c-95a2-33c21be83d85 could not be found. Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bbd3aa0-103c-478c-95a2-33c21be83d85 could not be found. Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5283d199-5e16-4382-ad32-e383636078ab tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] Returning 404 to user: Volume 0bbd3aa0-103c-478c-95a2-33c21be83d85 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5283d199-5e16-4382-ad32-e383636078ab tempest-VolumesGetTestJSON-1068734283 tempest-VolumesGetTestJSON-1068734283-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85" status: 404 len: 109 microversion: 2.1 time: 0.042037 Oct 10 12:07:44.360909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 11/16] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:07:44 2022] GET /compute/v2.1/os-volumes/0bbd3aa0-103c-478c-95a2-33c21be83d85 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:07:56.272052 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-09ffea05-9602-4855-a349-fe8343bec0d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: .version_select at 0x7f6d13839700>, body: {"keypair": {"name": "tempest-keypair-1360399903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+tvs4w0mVKHOqrVopU90a3oFo1+bXccLG1qykhKMSPGbSEbkBucw3hTtSzTbdCzKEvVFMkzZcOyNXSUv5tS7fMxAVab/MA2XECqgRhKKsSN/AHozOfKb/4wi65geO/3w=="}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:56.339680 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-09ffea05-9602-4855-a349-fe8343bec0d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:07:56.352337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-09ffea05-9602-4855-a349-fe8343bec0d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:07:56.520268 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-09ffea05-9602-4855-a349-fe8343bec0d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.732389 Oct 10 12:07:56.530125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 6/17] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:07:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:07:58.431581 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-104824497", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "networks": [{"uuid": "8f18c3f5-60a6-4ca6-86fb-adfdf9eca981"}]}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:58.891957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] validate_networks() for [('8f18c3f5-60a6-4ca6-86fb-adfdf9eca981', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:07:59.567110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d539c32d-f2d2-40bd-bfca-55c1bdf309cf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'create', calling method: .version_select at 0x7f6d137b21f0>, body: {"keypair": {"name": "tempest-keypair-826154291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8oW14RGMMpJ24zI8sSGdt+o6cN1EW2bEkz01QnOae3D1CzngNrPpWrh9NH23sLqYTyHE7AmxnM3NErzaiHbO6dH4f/Nlx5VmL2COEkSB9Bt9B926WdRqQy771cL6thg=="}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:07:59.606122 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-d539c32d-f2d2-40bd-bfca-55c1bdf309cf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for project 98437356d32f4230bce856ce6ddae66a. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:07:59.619667 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-d539c32d-f2d2-40bd-bfca-55c1bdf309cf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for user b334b2401e14419284cce2ad61442d4a and project 98437356d32f4230bce856ce6ddae66a. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:07:59.767678 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d539c32d-f2d2-40bd-bfca-55c1bdf309cf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.103033 Oct 10 12:07:59.768779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 7/18] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:07:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:00.449124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-723939493", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:00.628904 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] validate_networks() for [('67af5388-ef78-467a-b602-e98d5343259e', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:08:01.840172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:01.840801 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:01.841077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:01.841639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:01.842214 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:01.911275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:01.912304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:01.913016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:01.915522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:01.916265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:01.917791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:01.980495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Getting quotas for project f87226283dcb4d6fb203cc5e06cf13b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:01.994817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Getting quotas for user 6bc73e7bcf19443a940b6969e1be8e47 and project f87226283dcb4d6fb203cc5e06cf13b2. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:02.011834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:02.022496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:02.502405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-38158d21-ba70-4a18-bc61-8d104861ff4a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.887579 Oct 10 12:08:02.506109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 12/19] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:08:02.595661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Flavor limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:02.597393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Image limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:02.598053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Flavor pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:02.598634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Image pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:02.600188 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:02.666061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:02.666585 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:02.667083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:02.670086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:02.670609 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:02.674383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:02.758093 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for project 782c5fd84235487caac5f9a7e18563cb. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:02.770049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for user 45c87aa85b7d45fe8acf6f36a3d2a639 and project 782c5fd84235487caac5f9a7e18563cb. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:02.833251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Going to run 1 instances... {{(pid=121298) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:02.841256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:03.055089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4b54a787-162b-47cc-b35d-95836961db2d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'create', calling method: .version_select at 0x7f6d12e55550>, body: {"keypair": {"name": "tempest-keypair-1362175690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQZcj3HHhI6ihIPp6EUuE3MbxoOjwHT6Z8AOoB6mWxadg0idE2dYASTswRjllP7UbG3pOo/9+lSHSM+M4jDTiudO3WrYj41WhAcCTzVICNtBNVywqsrQO1ImFfn9J5O1A=="}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:03.102027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6212e036-e07a-4094-bb3e-daa63758fc34 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.332243 Oct 10 12:08:03.103340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 8/20] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:07:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:08:03.111055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c523ccac-56be-47f8-aebc-1b8c42d6e86f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:03.111880 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c523ccac-56be-47f8-aebc-1b8c42d6e86f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:03.204952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-4b54a787-162b-47cc-b35d-95836961db2d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:03.220737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-4b54a787-162b-47cc-b35d-95836961db2d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for user a7a87488f78444c3ad820527e5fbc099 and project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:03.349691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c523ccac-56be-47f8-aebc-1b8c42d6e86f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:03.377234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4b54a787-162b-47cc-b35d-95836961db2d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.869443 Oct 10 12:08:03.382937 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 13/21] 10.222.0.46 () {62 vars in 1200 bytes} [Mon Oct 10 12:08:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 871 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 12:08:03.387229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8f21e8d6-0368-421d-bee7-363cb09b45f7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:03.388220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8f21e8d6-0368-421d-bee7-363cb09b45f7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:03.393417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c523ccac-56be-47f8-aebc-1b8c42d6e86f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1214 microversion: 2.1 time: 0.277544 Oct 10 12:08:03.394250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 9/22] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:03 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:03.432974 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-698140161", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f74af49-8f08-437e-8de8-52cf94d07154"}], "security_groups": [{"name": "tempest-securitygroup--1863235096"}], "key_name": "tempest-keypair-1360399903", "user_data": "}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:03.673250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f21e8d6-0368-421d-bee7-363cb09b45f7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:03.723971 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8f21e8d6-0368-421d-bee7-363cb09b45f7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1221 microversion: 2.1 time: 0.344755 Oct 10 12:08:03.724590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 14/23] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:03 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1221 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:03.912587 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] validate_networks() for [('3f74af49-8f08-437e-8de8-52cf94d07154', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:08:04.001892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1755704907", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:04.157903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] validate_networks() for [('67af5388-ef78-467a-b602-e98d5343259e', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:08:05.496661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:05.498796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:05.498796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:05.498796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:05.498796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:05.516127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:05.517105 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:05.518022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:05.519411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:05.520796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:05.522486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:05.555261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:05.560213 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:05.588542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Going to run 1 instances... {{(pid=121298) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:05.591696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:05.681637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:05.682154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:05.682743 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:05.683299 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:05.683805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:05.694574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:05.696155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:05.696715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:05.697782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:05.698499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:05.699062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:05.733139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for project 782c5fd84235487caac5f9a7e18563cb. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:05.738219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for user 45c87aa85b7d45fe8acf6f36a3d2a639 and project 782c5fd84235487caac5f9a7e18563cb. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:05.814800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:05.815685 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0d26afca-4c7c-417b-a867-b248ac14fd01 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.397468 Oct 10 12:08:05.817101 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 10/24] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:08:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:08:05.826565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:05.860844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:05.864051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:05.921048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:05.924837 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:05.924837 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:05.924837 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:05.929821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:05.931394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:06.096896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-91e546fa-806e-4276-b2f2-4113fa49471e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.100628 Oct 10 12:08:06.106050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 15/25] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:08:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:08:06.117277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-787038183", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8981a50-f1b5-4a9f-bc84-d19589293c21"}], "security_groups": [{"name": "tempest-securitygroup--577721085"}], "key_name": "tempest-keypair-826154291", "user_data": "}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:06.565393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:06.610222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-322ce9e7-b9a2-4c79-a4a2-6e9f5322f81f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1218 microversion: 2.1 time: 0.781916 Oct 10 12:08:06.612352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 11/26] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:05 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1218 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:06.626750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-98a80d3b-e5aa-42bb-9af8-a0ce3d365902 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:06.629158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-98a80d3b-e5aa-42bb-9af8-a0ce3d365902 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:06.719712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] validate_networks() for [('f8981a50-f1b5-4a9f-bc84-d19589293c21', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:08:06.837613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-98a80d3b-e5aa-42bb-9af8-a0ce3d365902 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:06.848235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-98a80d3b-e5aa-42bb-9af8-a0ce3d365902 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1241 microversion: 2.1 time: 0.232638 Oct 10 12:08:06.849045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 12/27] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:06 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1241 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:06.856492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b4f7e620-e347-4406-9caa-b1187dc2fb68 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:06.857397 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b4f7e620-e347-4406-9caa-b1187dc2fb68 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:07.402111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b4f7e620-e347-4406-9caa-b1187dc2fb68 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:07.412708 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b4f7e620-e347-4406-9caa-b1187dc2fb68 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1222 microversion: 2.1 time: 0.560828 Oct 10 12:08:07.413828 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 13/28] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:06 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1222 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:07.643609 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:07.644226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:07.652417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:07.652925 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:07.659056 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:07.660647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:07.661295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:07.661885 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.053231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:08.064184 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-92e6cb92-6782-4026-9ab8-e8cdfef500d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1266 microversion: 2.1 time: 0.424224 Oct 10 12:08:08.065410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 14/29] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:07 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:08.071247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:08.077899 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:08.079939 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.080915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.081569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.083136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.083794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.085362 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.180787 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:08.222569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a5c51f62-076f-4119-b118-6e1bb8eb2833 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1245 microversion: 2.1 time: 0.153729 Oct 10 12:08:08.226349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 15/30] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:08 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:08.377509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:08.377956 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:08.378470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:08.378962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:08.379379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:08.392893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.398934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.398934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.398934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.398934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.399403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.415461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for project 98437356d32f4230bce856ce6ddae66a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:08.433643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for user b334b2401e14419284cce2ad61442d4a and project 98437356d32f4230bce856ce6ddae66a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:08.441583 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:08.442594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:08.468386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.474255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.478797 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.481559 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:08.487905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:08.487905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:08.512907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:08.525563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:08.693219 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:08.717042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-177abb4f-b693-4460-9393-160911101f32 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1226 microversion: 2.1 time: 0.278209 Oct 10 12:08:08.739930 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 16/31] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:08 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1226 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:08.872170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0a03b812-3a43-44ac-9ef7-dd8ad752f7e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.749457 Oct 10 12:08:08.885875 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0f05f4ba-16da-41b8-adcf-c502148c461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:08.886615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0f05f4ba-16da-41b8-adcf-c502148c461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:08.897602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 16/32] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:08:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:08:09.091747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:09.092383 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:09.107569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.108203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.109459 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.110225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.110725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.115613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.307977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0f05f4ba-16da-41b8-adcf-c502148c461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:09.321292 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0f05f4ba-16da-41b8-adcf-c502148c461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1236 microversion: 2.1 time: 0.439485 Oct 10 12:08:09.326806 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 17/33] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:08 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1236 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:09.364752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:09.365556 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:09.374779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.376327 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.377555 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.378570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.379235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.379845 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.578162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:09.587830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4d0a8466-b181-4fcf-9e24-5e1616b6efdb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1237 microversion: 2.1 time: 0.263218 Oct 10 12:08:09.591718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 18/34] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:09 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1237 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:09.593333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:09.627848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-40db3c81-3f3f-4d1f-aef0-0ee2c4798b6b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1284 microversion: 2.1 time: 0.540001 Oct 10 12:08:09.634739 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 17/35] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:09 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1284 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:09.759349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:09.763329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:09.774241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.775035 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.775685 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.777130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:09.777799 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:09.778545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:09.913757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:09.923036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-01564c31-8801-4e96-a4a8-78eed59ff3db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1218 microversion: 2.1 time: 0.181913 Oct 10 12:08:09.926165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 19/36] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:09 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:10.351005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-80f24e99-bc85-4e3f-bb87-636f7c9fba6c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:10.351639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-80f24e99-bc85-4e3f-bb87-636f7c9fba6c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:10.602369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-80f24e99-bc85-4e3f-bb87-636f7c9fba6c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:10.612135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-80f24e99-bc85-4e3f-bb87-636f7c9fba6c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1236 microversion: 2.1 time: 0.266409 Oct 10 12:08:10.612742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 18/37] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:10 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1236 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:10.614152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:10.614949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:10.627060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:10.627570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:10.628060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:10.628700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:10.629155 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:10.629588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:10.667679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:10.669363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:10.677347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:10.678126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:10.679317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:10.680580 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:10.682920 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:10.683740 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:10.953468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:10.970942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f3d93adb-dacc-4d2a-baca-c140ab6a56d0 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1272 microversion: 2.1 time: 0.307732 Oct 10 12:08:10.971862 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:10.974902 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 19/38] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:10 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1272 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:10.992616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1882945481", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bb565bd-53c5-4c6d-b08f-259f391c730b"}], "security_groups": [{"name": "tempest-securitygroup--1057717224"}], "key_name": "tempest-keypair-1362175690", "user_data": "}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:10.999866 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-91edeec4-9c02-4d8c-a844-94ee39c2fba6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1293 microversion: 2.1 time: 0.390182 Oct 10 12:08:11.007294 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 20/39] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:10 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1293 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:11.038448 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:11.044991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:11.060090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:11.060836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:11.061547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:11.065671 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:11.066194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:11.066651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:11.764503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:11.792877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-30e2aecc-a940-4c50-87db-411738e87339 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1218 microversion: 2.1 time: 0.768887 Oct 10 12:08:11.794706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 21/40] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:11 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1218 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:11.823993 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:11.824628 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:11.840776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:11.841263 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:11.841707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:11.842414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:11.854803 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:11.855777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:11.865858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] validate_networks() for [('8bb565bd-53c5-4c6d-b08f-259f391c730b', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:08:12.471872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:12.492291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d65ee8ed-6eac-429f-87c2-2052d2253a28 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1232 microversion: 2.1 time: 0.693479 Oct 10 12:08:12.493766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 22/41] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:11 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1232 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:12.528866 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:12.529471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:12.571411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:12.583001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:12.584327 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:12.589234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:12.589234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:12.589234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:13.137570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:13.147716 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-073511b3-87fa-494a-9929-1030ba93c6d5 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1272 microversion: 2.1 time: 0.653161 Oct 10 12:08:13.149782 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 23/42] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:12 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1272 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:13.158787 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:13.170172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:13.191052 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.191836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.192511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:13.193718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.195980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.196670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:13.586810 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:13.604509 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-df7ad593-6ff6-4d9b-b620-a263ea8e419c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1299 microversion: 2.1 time: 0.451384 Oct 10 12:08:13.605905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 24/43] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:13 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1299 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:13.632636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:13.635784 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:13.653463 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.654085 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.669514 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:13.671511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.673359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.674338 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:13.908860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:13.921779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4cc7091e-f657-405b-b51e-947ff580ed8a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1280 microversion: 2.1 time: 0.309985 Oct 10 12:08:13.924695 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 25/44] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:13 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:13.936039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:13.939485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:13.948927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:13.953430 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.953949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.955608 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:13.957512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:13.965503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:13.965503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:14.240205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:14.258251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-59b4b04d-846d-4f6a-a7af-f36eb1d7196c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1288 microversion: 2.1 time: 0.330028 Oct 10 12:08:14.264180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 26/45] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:13 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1288 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:14.295801 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:14.296962 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:14.315197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:14.316145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:14.316760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:14.317822 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:14.319867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:14.320976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:14.488843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:08:14.490229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:08:14.491267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:08:14.491837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:08:14.493365 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:08:14.509252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:14.510266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:14.510748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:14.512119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:14.512796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:14.514184 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:14.562510 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:08:14.585611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for user a7a87488f78444c3ad820527e5fbc099 and project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:08:14.639583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:08:14.646719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:08:14.863229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-32bcb9af-4859-44a4-96db-f3c9a5eadf64 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.886122 Oct 10 12:08:14.874986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 20/46] 10.222.0.46 () {62 vars in 1188 bytes} [Mon Oct 10 12:08:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3899 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 12:08:14.907855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:14.915586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:14.926234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:14.928161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:14.929414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:14.930423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:14.931061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:14.931704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:15.033120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.093931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-601ed06e-0d79-4178-85d2-925cbab509ef tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.816022 Oct 10 12:08:15.093931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 27/47] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:14 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:15.127088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fb11655e-8712-48d7-bb86-09c6e4a88cfa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:15.128826 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fb11655e-8712-48d7-bb86-09c6e4a88cfa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:15.306306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.323045 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8d756f43-dcc3-40c0-90fa-6ee973202e78 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1299 microversion: 2.1 time: 0.444216 Oct 10 12:08:15.327937 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 21/48] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:14 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1299 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:15.354935 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:15.362633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:15.389859 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fb11655e-8712-48d7-bb86-09c6e4a88cfa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.399700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fb11655e-8712-48d7-bb86-09c6e4a88cfa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.405297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fb11655e-8712-48d7-bb86-09c6e4a88cfa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.408903 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fb11655e-8712-48d7-bb86-09c6e4a88cfa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1282 microversion: 2.20 time: 0.315659 Oct 10 12:08:15.410462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:15.411084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:15.411533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:15.411739 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 28/49] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:15 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1282 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:15.415492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:15.415986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:15.418535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:15.422655 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:15.423489 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:15.442310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:15.445086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:15.445086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:15.445864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:15.447370 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:15.449079 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:15.543170 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=4 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:15.582037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.596995 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-be3f4a2c-c371-4541-bcc5-1043cf9e647f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1280 microversion: 2.1 time: 0.266296 Oct 10 12:08:15.598470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 22/50] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:15 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:15.674624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:15.685713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8337a8ee-6a27-4da1-84aa-35e76c04bd6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1294 microversion: 2.1 time: 0.271257 Oct 10 12:08:15.686329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 29/51] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:15 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1294 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:16.118976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:16.120236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:16.141551 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:16.146796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:16.151570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:16.153975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:16.158575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:16.161968 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:16.360473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:16.361118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:16.386781 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:16.393175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:16.393175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:16.393175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:16.393987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:16.394355 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:17.652708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:17.661828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-593cc583-5d31-4c7d-bd35-b9156a6f0184 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 1.549170 Oct 10 12:08:17.665126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 23/52] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:16 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:17.679486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:17.691249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:17.699577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:17.716565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:17.717077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:17.717521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:17.718335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:17.718834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:17.719255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:18.094559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:18.133921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:18.135425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:18.144150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-58a3129c-5373-435c-a9ea-5dafb36db372 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1334 microversion: 2.20 time: 0.476332 Oct 10 12:08:18.145293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 24/53] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:17 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1334 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:18.150230 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:18.150899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:18.157976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.158795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.159412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:18.163309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.163953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.164540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:18.175541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:18.193949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:18.205732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b3708d8b-412d-4483-ac33-460b7c724562 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 1.855725 Oct 10 12:08:18.212790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 30/54] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:16 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:18.229661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:18.237329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:18.288433 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.290631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.291474 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:18.292223 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.292689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.293124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:18.581731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:18.602613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5819cae1-07d3-4fa4-84e4-5b41dfe1defc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1294 microversion: 2.1 time: 0.388034 Oct 10 12:08:18.635049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 31/55] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:18 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1294 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:18.691602 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:18.692407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:18.703537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.708112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.708112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:18.708112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:18.708112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:18.708413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.085704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:19.136579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-53ee679a-cc86-4bd8-ade1-4d4eeedea7d8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.989696 Oct 10 12:08:19.138826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 25/56] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:18 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:19.188399 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:19.197541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:19.253247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:19.254103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:19.254760 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.262205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:19.262205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:19.262205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.595986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:19.624797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:19.628293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:19.630059 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-855be7af-69b1-46f8-ba6b-4e205d140e19 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1334 microversion: 2.20 time: 0.449550 Oct 10 12:08:19.635934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 26/57] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:19 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1334 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:08:19.676005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:19.677639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:19.694736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:19.699069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:19.699069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.699069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:19.700694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:19.701816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.705456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:19.743961 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fd439f78-c216-4a80-87a8-8697c76bd0d7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 1.046210 Oct 10 12:08:19.754759 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 32/58] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:18 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:19.764100 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:19.764100 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:19.801894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:19.806194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:19.806194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:19.809782 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:19.810854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:19.811687 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:21.049948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:21.105787 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f97402ba-40fb-4567-9542-ef8e6e6dae50 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 1.472546 Oct 10 12:08:21.113356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 27/59] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:19 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:21.132770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:21.134252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:21.148429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:21.149303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:21.155368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:21.155368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:21.155368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:21.156648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.068934 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:22.095633 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-aa6cc0ed-d704-4181-a5d4-5979006ddcf6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 2.336062 Oct 10 12:08:22.100796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 33/60] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:19 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:22.129566 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:22.141970 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:22.181731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.183247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.184261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.185837 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.186965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.187984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.493770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:22.529086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:22.532434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:22.535867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0f8d79b7-b2f5-4885-ac30-b9e9670264b8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1340 microversion: 2.20 time: 0.432076 Oct 10 12:08:22.538253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 34/61] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:22 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1340 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:22.568386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:22.570846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:22.592927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.593566 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.594145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.620112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:22.628891 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:22.631289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:22.834010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:22.871587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-047ca018-e805-4312-8658-7c28e34ae81c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 1.755322 Oct 10 12:08:22.909562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 28/62] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:21 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:23.096257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-f2cd5570-8edf-44ef-b187-abc7600b42a0 req-425806ab-b07e-4f16-bcfe-1ce4276523da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d92bcf3-e567-46a0-a87e-ab1f89a16842", "tag": "baa47217-65c4-4e53-be16-7c13a9be2c74"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:23.124166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f2cd5570-8edf-44ef-b187-abc7600b42a0 req-425806ab-b07e-4f16-bcfe-1ce4276523da service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.125501 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f2cd5570-8edf-44ef-b187-abc7600b42a0 req-425806ab-b07e-4f16-bcfe-1ce4276523da service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.126491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f2cd5570-8edf-44ef-b187-abc7600b42a0 req-425806ab-b07e-4f16-bcfe-1ce4276523da service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.174145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-f2cd5570-8edf-44ef-b187-abc7600b42a0 req-425806ab-b07e-4f16-bcfe-1ce4276523da service nova] Creating event network-changed:baa47217-65c4-4e53-be16-7c13a9be2c74 for instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 on hv-cinder-86020 Oct 10 12:08:23.176520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f2cd5570-8edf-44ef-b187-abc7600b42a0 req-425806ab-b07e-4f16-bcfe-1ce4276523da service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 12:08:23.177581 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f2cd5570-8edf-44ef-b187-abc7600b42a0 req-425806ab-b07e-4f16-bcfe-1ce4276523da service nova] Acquired lock "compute-rpcapi-router" {{(pid=121297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 12:08:23.181934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.182717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.186467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.186467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.187151 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.188861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.213026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.compute.rpcapi [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 12:08:23.215210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=121297) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 12:08:23.249205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7eec9dc2-b220-4569-b3f6-553e83d8a2f6 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336962 Oct 10 12:08:23.250924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 29/63] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:23.263176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:23.265557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:23.280408 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.281913 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.283456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.285226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.286409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.288047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.679240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:23.697790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b1ca1627-0b90-4195-9133-3e7c24e1871e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 1.157669 Oct 10 12:08:23.701532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 35/64] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:22 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:23.893193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:23.895177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-0fa15fbf-0e9e-4961-8c94-127472b76f7c req-dbe88dd8-79a0-4e96-b604-72873880cc04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cef35a8-bca8-406f-b7e1-ffaaa71927df", "tag": "25665116-9189-467a-8aa2-fed12c932b37"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:23.920169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0fa15fbf-0e9e-4961-8c94-127472b76f7c req-dbe88dd8-79a0-4e96-b604-72873880cc04 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.921816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0fa15fbf-0e9e-4961-8c94-127472b76f7c req-dbe88dd8-79a0-4e96-b604-72873880cc04 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.923733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0fa15fbf-0e9e-4961-8c94-127472b76f7c req-dbe88dd8-79a0-4e96-b604-72873880cc04 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.946774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-29c5cc9a-653d-42ee-a3a0-0ab299fb8b10 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.688930 Oct 10 12:08:23.951152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 30/65] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:23 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:23.973222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-0fa15fbf-0e9e-4961-8c94-127472b76f7c req-dbe88dd8-79a0-4e96-b604-72873880cc04 service nova] Creating event network-changed:25665116-9189-467a-8aa2-fed12c932b37 for instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df on hv-cinder-86020 Oct 10 12:08:23.974094 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0fa15fbf-0e9e-4961-8c94-127472b76f7c req-dbe88dd8-79a0-4e96-b604-72873880cc04 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 12:08:23.974483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0fa15fbf-0e9e-4961-8c94-127472b76f7c req-dbe88dd8-79a0-4e96-b604-72873880cc04 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 12:08:23.976270 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.976735 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.977348 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:23.978492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:23.979070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:23.980247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:23.980950 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:23.984280 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.010976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.compute.rpcapi [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 12:08:24.010976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] Releasing lock "compute-rpcapi-router" {{(pid=121298) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 12:08:24.015337 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.018385 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.019069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.020173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.023068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.023940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.051151 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-beeeec04-b209-471e-bb0b-160c0d03675f None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347363 Oct 10 12:08:24.053018 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 36/66] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:24.064122 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:24.066359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:24.082977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.085537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.093634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.095858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.098249 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.100408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.301163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:24.328572 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:24.341696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:24.344240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cc7d28f9-0a9d-4a61-aed5-8535f94ebf86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1340 microversion: 2.20 time: 0.288795 Oct 10 12:08:24.344922 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 37/67] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:24 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1340 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:24.376037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:24.377696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:24.390021 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.390857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.391574 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.392871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.393889 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.394752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.451798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:24.469335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f408db54-a7fd-440e-ab28-f9245cf1e553 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.514418 Oct 10 12:08:24.469938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 31/68] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:23 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:24.611985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:24.623507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cca1bef1-7826-4189-81d5-e5a0fcbf7e50 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.276629 Oct 10 12:08:24.624678 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 38/69] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:24 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:24.741259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:24.742503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:24.744884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=32 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:24.750132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.751016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.751795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.752871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.753400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.760959 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:24.920105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:24.929028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a95a3992-e57d-4aa9-9513-b97fc93d09a1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.192072 Oct 10 12:08:24.929615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 32/70] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:24 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:24.992087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:24.992681 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:24.998862 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:24.999340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:24.999769 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.000482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.000926 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.001344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.172104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:25.181570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f72f9fb8-a66a-4f2a-84a7-7178890d4f30 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.193827 Oct 10 12:08:25.182153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 39/71] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:24 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:25.387654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:25.387828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:25.394697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.395207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.395642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.396373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.396822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.397245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.400717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-295d67ec-d3ba-4f34-941a-a7a7a21e1746 req-ca235e62-5988-4d75-9d91-35fdb23ee61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb9c640-3e33-4e42-a21e-cdcce980b06a", "tag": "f65861f8-ce58-4ca5-a150-dd1cbc87aba1"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:25.406810 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=30 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:25.412814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-295d67ec-d3ba-4f34-941a-a7a7a21e1746 req-ca235e62-5988-4d75-9d91-35fdb23ee61b service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.413747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-295d67ec-d3ba-4f34-941a-a7a7a21e1746 req-ca235e62-5988-4d75-9d91-35fdb23ee61b service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.414231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-295d67ec-d3ba-4f34-941a-a7a7a21e1746 req-ca235e62-5988-4d75-9d91-35fdb23ee61b service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.426379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-295d67ec-d3ba-4f34-941a-a7a7a21e1746 req-ca235e62-5988-4d75-9d91-35fdb23ee61b service nova] Creating event network-changed:f65861f8-ce58-4ca5-a150-dd1cbc87aba1 for instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a on hv-cinder-86020 Oct 10 12:08:25.432266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-295d67ec-d3ba-4f34-941a-a7a7a21e1746 req-ca235e62-5988-4d75-9d91-35fdb23ee61b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036286 Oct 10 12:08:25.432901 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 40/72] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:25.496997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:25.498348 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:25.506937 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.508029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.508823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.511190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.512086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.512865 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.602811 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:25.613700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:25.615458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:25.619789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-98c9c231-35fc-4ce7-ad20-c84fe27a201e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.235982 Oct 10 12:08:25.619789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 33/73] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:25 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:25.647989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:25.648601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:25.655067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.655552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.655988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.656678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.657139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.657652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.676274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:25.680146 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:25.689358 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-87701ef7-d795-4712-9db9-606990484be7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.199219 Oct 10 12:08:25.703104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 41/74] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:25 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:25.817958 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:25.825953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6693edab-72bc-4375-9ae2-89c34350b640 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.182124 Oct 10 12:08:25.826531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 34/75] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:25 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:25.953533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:25.954563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:25.962238 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.962816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.963492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:25.964621 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:25.965090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:25.965523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.151798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:26.171957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-20b0afd7-5957-4a80-ae95-180684ed56cd tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.222949 Oct 10 12:08:26.173342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 42/76] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:25 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:26.206076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:26.206975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:26.215024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.215512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.215941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.216669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.217113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.217531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.284254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-7ed3f433-8fc6-4439-9a28-ef96e3a4a712 req-64e9216e-2b2b-4781-9b4e-62ef2f048a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a693f249-110a-4836-a0db-7c668d53a918", "tag": "7952dcbe-5751-4c3a-ad46-5f684e765d16"}, {"name": "network-changed", "server_uuid": "13c0121a-4f1a-4265-9efd-5a969d73bb7e", "tag": "63d53b17-0e7f-4e84-aa0c-4d6908cd174a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:26.297045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-7ed3f433-8fc6-4439-9a28-ef96e3a4a712 req-64e9216e-2b2b-4781-9b4e-62ef2f048a8e service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.297766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-7ed3f433-8fc6-4439-9a28-ef96e3a4a712 req-64e9216e-2b2b-4781-9b4e-62ef2f048a8e service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.298342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-7ed3f433-8fc6-4439-9a28-ef96e3a4a712 req-64e9216e-2b2b-4781-9b4e-62ef2f048a8e service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.318132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-7ed3f433-8fc6-4439-9a28-ef96e3a4a712 req-64e9216e-2b2b-4781-9b4e-62ef2f048a8e service nova] Creating event network-changed:7952dcbe-5751-4c3a-ad46-5f684e765d16 for instance a693f249-110a-4836-a0db-7c668d53a918 on hv-cinder-86020 Oct 10 12:08:26.319796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-7ed3f433-8fc6-4439-9a28-ef96e3a4a712 req-64e9216e-2b2b-4781-9b4e-62ef2f048a8e service nova] Creating event network-changed:63d53b17-0e7f-4e84-aa0c-4d6908cd174a for instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e on hv-cinder-86020 Oct 10 12:08:26.329793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-7ed3f433-8fc6-4439-9a28-ef96e3a4a712 req-64e9216e-2b2b-4781-9b4e-62ef2f048a8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048927 Oct 10 12:08:26.331616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 43/77] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:08:26.377440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:26.385697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5ee3819b-5276-464c-8b40-4c3b1cb5da1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.183433 Oct 10 12:08:26.386314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 35/78] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:26 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:26.647573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:26.648633 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:26.659581 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.660455 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.661253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.662563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.663431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.664214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.714954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:26.715797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:26.722562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.723314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.729306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.730653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.731572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.732369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.908593 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:26.938562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:26.940226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:26.941801 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:26.944080 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-655b1468-9f82-49b2-abf3-2999f986c477 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.302601 Oct 10 12:08:26.944912 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 44/79] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:26 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:26.950134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:26.950914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:26.957737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.958244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.958754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.960229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:26.960701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:26.961136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:26.975633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2238688d-531c-42cf-b2ed-fa2dba4ca6ee tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.264996 Oct 10 12:08:26.977837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 36/80] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:26 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:27.163399 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:27.177459 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-79e5cde8-6a2d-4b8a-aa28-cdbba97c5815 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.231286 Oct 10 12:08:27.179098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 45/81] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:26 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:27.220279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:27.222871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:27.238436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.239330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.240108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:27.242312 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.243249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.244001 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:27.389582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:27.398946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2ca1a500-5153-4ba7-8ead-4b06c8345065 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.189368 Oct 10 12:08:27.399549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 37/82] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:27 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:27.409868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:27.410390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:27.417545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.418042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.418487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:27.419230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.419685 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.420111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:27.574116 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:27.582434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7cf5becf-93cf-47a2-9721-2e13674d58ec tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.176518 Oct 10 12:08:27.583058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 46/83] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:27 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:27.975091 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:27.975725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:27.982588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.983095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.983543 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:27.984243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:27.984692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:27.985299 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.001013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:28.001636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:28.017012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.017957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.018630 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.019610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.020228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.020846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.284982 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.285871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.316535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.317076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-716bf084-b181-4798-9912-141ed78e1752 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.316537 Oct 10 12:08:28.317755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 47/84] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:27 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:28.320198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.322333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eafc7555-912d-4fa1-abb1-ee108bceeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.351034 Oct 10 12:08:28.323064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:28.323544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 38/85] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:27 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:28.323956 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:28.330706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.331199 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.331647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.332350 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.332843 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.333301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.428860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:28.430277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:28.443296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.444986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.446084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.447941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.449072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.450193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.498173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.507948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-763999f5-76d3-4456-84e8-9954c97b6349 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.189033 Oct 10 12:08:28.508649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 48/86] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:28 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:28.611168 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:28.612638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:28.626781 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.627621 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.628449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.629798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:28.631181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:28.632277 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:28.638773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:28.651248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.695454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-71a9da8c-cae3-49e9-85ea-6f1e7f58ab68 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.274643 Oct 10 12:08:28.700072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 39/87] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:28 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:28.851651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:28.860477 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b1e4b531-2c42-4449-87d1-ac2d9172e290 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.256125 Oct 10 12:08:28.861068 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 49/88] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:28 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:29.572373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:29.572373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:29.572373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.572373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.574112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.574112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.574112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.574112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.574396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:29.574396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:29.574396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.574396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.575050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.575050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.575050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.575050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.655722 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:29.668015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:29.674697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:29.676491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5c1754d9-a044-4690-adfb-af8831856ab0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.337812 Oct 10 12:08:29.677245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 40/89] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:29 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:29.678372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:29.681446 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0adf2f1f-3026-4b2d-b8e3-f1ef8e037a0b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.319795 Oct 10 12:08:29.691041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:29.691041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:29.699363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 50/90] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:29 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:29.712058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.719076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.719831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.720791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.721440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.722093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.766224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:29.767074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:29.783781 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.785000 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.786228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:29.787899 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:29.789969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:29.791047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:30.520385 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:30.542788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c27f2567-603e-429d-84e2-6d911aeafb5f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.822121 Oct 10 12:08:30.543652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 51/91] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:29 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:30.548966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:30.551876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:30.553351 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:30.562941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:30.563736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:30.564498 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:30.565421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:30.566058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:30.567492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:30.568178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-040fdacd-f92e-47de-adb9-0239f424c9dc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.888612 Oct 10 12:08:30.575309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 41/92] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:29 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:30.723754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:30.724712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:30.736662 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:30.737653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:30.741619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:30.741619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:30.741619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:30.742110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:31.424469 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:31.447042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e04cbff1-6efa-4e2d-9283-e86cfb99eb42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.901701 Oct 10 12:08:31.450497 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:31.464170 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 52/93] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:30 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:31.484166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:31.485282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:31.485755 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cef7ad87-124f-4bd3-8e7d-177c06727ea5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.768581 Oct 10 12:08:31.500346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:31.500346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:31.500346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:31.500346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:31.500715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:31.500805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 42/94] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:30 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:31.500904 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:31.583084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:31.583994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:31.593659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:31.594169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:31.594607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:31.595368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:31.595821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:31.596248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:31.791457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:31.811475 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:31.813894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:31.823095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7b5dc335-58ec-4424-b872-d50371560972 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.349766 Oct 10 12:08:31.826363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 53/95] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:31 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:31.837388 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:31.841317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:31.861482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:31.862195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:31.862864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:31.865051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:31.868143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:31.868854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.154020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:32.167987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f2f95a7e-5353-4443-93a5-cec4fd50abb2 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.589063 Oct 10 12:08:32.192387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 43/96] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:31 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:32.345710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:32.354192 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e50f6acc-04b5-42ce-95c2-a8943e91284b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.526346 Oct 10 12:08:32.372786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 54/97] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:31 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:32.490020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:32.490892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:32.498260 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.498788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.499229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.499964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.500418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.500844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.537492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:32.537492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:32.541553 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.542177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.542718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.543554 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.544193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.544643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.754853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:32.765359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-17699d2e-99af-40ba-8d15-24146463f89c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.282806 Oct 10 12:08:32.765954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 44/98] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:32 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:32.770645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-92ef750e-af46-4b1c-941b-27023513f51b req-0f8c16fd-8982-430c-a226-045ca950af6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e51573a-beab-4197-840e-a9427a52e273", "tag": "98e81f6a-0ff4-4344-ab00-e77663d7f2cf"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:32.776352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:32.780956 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-92ef750e-af46-4b1c-941b-27023513f51b req-0f8c16fd-8982-430c-a226-045ca950af6f service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.781429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-92ef750e-af46-4b1c-941b-27023513f51b req-0f8c16fd-8982-430c-a226-045ca950af6f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.782056 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-92ef750e-af46-4b1c-941b-27023513f51b req-0f8c16fd-8982-430c-a226-045ca950af6f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.790936 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bbf08f40-aab2-45ca-9f43-3d0eeffb644b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.261237 Oct 10 12:08:32.791957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 55/99] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:32 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:32.798031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-92ef750e-af46-4b1c-941b-27023513f51b req-0f8c16fd-8982-430c-a226-045ca950af6f service nova] Creating event network-changed:98e81f6a-0ff4-4344-ab00-e77663d7f2cf for instance 3e51573a-beab-4197-840e-a9427a52e273 on hv-cinder-86020 Oct 10 12:08:32.804566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-92ef750e-af46-4b1c-941b-27023513f51b req-0f8c16fd-8982-430c-a226-045ca950af6f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037355 Oct 10 12:08:32.809935 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 45/100] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:32.890036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:32.890644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:32.897019 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.897505 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.897935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:32.898635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:32.899124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:32.899542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.054967 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:33.067163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:33.068675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:33.069902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ad7fee4e-31da-4311-937a-c0f5a49e3550 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.184189 Oct 10 12:08:33.070848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 56/101] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:32 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:33.202561 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:33.203328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:33.208731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=10 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:33.210981 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.212035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.212035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.212643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.213091 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.213514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.382449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:33.383100 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:33.391078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.391898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.392581 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.393754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.394218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:33.394548 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.395358 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.407697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a6f4a74e-9bc7-4de9-be0a-26d77c2c2530 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.209014 Oct 10 12:08:33.408675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 46/102] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:33 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:33.581818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:33.595291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-296ffcb9-770a-418d-8f89-fa053f52ed19 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.216467 Oct 10 12:08:33.596531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 57/103] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:33 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:33.802110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:33.802911 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:33.809925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.810620 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.811380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.812281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.812979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.813519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.816960 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:33.817785 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:33.827406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.828210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.828962 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:33.830129 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:33.830957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:33.833857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.006987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:34.100882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.109013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.109878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ca6fd412-2795-461b-9000-695a2f5e6305 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.311818 Oct 10 12:08:34.110493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 47/104] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:33 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:34.115862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:34.117451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:34.126175 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.126958 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.129668 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6597192d-10eb-4674-997e-178e5a89cca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.315987 Oct 10 12:08:34.132000 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 58/105] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:33 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:34.137578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.138496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.139080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.139566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.371083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.384806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.386802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.388780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9d4671c4-9916-49d2-8727-73003753c966 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.277035 Oct 10 12:08:34.389673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 48/106] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:34 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:34.451048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:34.452220 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:34.496975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.497299 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.498267 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.500133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.501032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.502046 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.636652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:34.639099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:34.653482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.654288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.655442 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.656405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:34.657095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:34.657773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:34.686250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.701597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9cdca7ce-e724-49b5-9ae9-54fff2ce81c3 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.258256 Oct 10 12:08:34.704144 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 59/107] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:34 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:34.820974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:34.830706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-72b62172-4b6e-4924-8892-e07a7ce924f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.201319 Oct 10 12:08:34.831428 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 49/108] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:34 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:35.152841 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:35.152841 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:35.164085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:35.165144 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.165903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:35.166222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.167123 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.168912 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.169764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.170588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.182825 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.184299 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.185471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.187088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.188309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.189570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.470228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:35.518719 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4e80ae8f-7083-4863-ac33-ad3604fb3189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.377064 Oct 10 12:08:35.531315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 60/109] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:35 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:35.555396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:35.558556 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:35.578971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.579848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.580632 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.581934 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.582760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.583495 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.589908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:35.602559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c45bc824-06ac-4d63-9965-c0a525fa644a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.448004 Oct 10 12:08:35.605258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 50/110] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:35 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:35.746169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:35.747975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:35.755730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.756962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.757821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.758781 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.759411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.773175 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.792268 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:35.807316 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:35.812425 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:35.815228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e8fe76fb-0d4e-4665-800d-74df76bbac69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.284431 Oct 10 12:08:35.816678 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 61/111] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:35 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:35.867544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:35.868172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:35.875156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.875653 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.876290 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:35.877218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:35.877687 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:35.878130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.046455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:36.053914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:36.062566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4e576f40-0665-442a-90fd-eb04d62e8ee7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.323075 Oct 10 12:08:36.064002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 51/112] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:35 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:36.101722 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:36.126800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4bcc2c75-7e5f-42e7-8c1b-ddb72d324205 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.263742 Oct 10 12:08:36.128128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 62/113] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:35 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:36.567417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:36.568009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:36.576199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.577548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.577818 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.578819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.579836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.580558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.655231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:36.656510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:36.674012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.675702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.676486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.677755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.678575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.679180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.883042 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:36.889221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:36.898852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9908f56b-0281-4854-83c6-64482c249c27 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.339298 Oct 10 12:08:36.899820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 52/114] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:36 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:36.904326 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a8812d26-0466-4572-a813-02b34e68dc92 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.270372 Oct 10 12:08:36.905291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 63/115] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:36 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:36.918439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:36.918439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:36.925209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.930259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.930259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:36.930259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:36.930259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:36.930825 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:37.096984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:37.098639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:37.112694 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:37.114183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:37.115584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:37.118462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:37.119733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:37.120838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:37.400697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:37.428644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:37.428830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:37.430862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-056d5c56-6e0b-4202-bab6-75a60bf63e31 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.528831 Oct 10 12:08:37.431866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 53/116] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:36 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:37.441194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:37.441886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:37.475145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:37.485970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:37.488301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:37.509928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:37.509928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:37.509928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.067375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.082302 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-df90f70c-67a4-4444-993d-28d2e22ebbed tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.992993 Oct 10 12:08:38.084143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 64/117] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:37 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:38.093823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.105572 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:38.111881 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:38.115121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-93fb1c73-617e-4648-90f6-172a3a7e6ad1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.680848 Oct 10 12:08:38.117531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 54/118] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:37 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:38.125576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:38.127131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:38.143089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.143598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.148570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.148570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.148570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.148570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.148999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.148999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.148999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.149758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.150456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.151156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.512462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.522542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:38.532753 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-99b26f06-a894-4d66-87ce-7da8973a2456 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.446635 Oct 10 12:08:38.534163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 65/119] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:38 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:38.544634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.566219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-36442849-99ef-4eae-9178-cf9a21c20a1a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.448073 Oct 10 12:08:38.567747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 55/120] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:38 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:38.577579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:38.578646 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:38.593283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.594467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.598222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.600470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.601044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.601788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.692763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-18e3bce4-19b0-45fd-97e0-c777b6cd56ab req-2865a716-89b4-422c-b841-d2993f5c3107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cef35a8-bca8-406f-b7e1-ffaaa71927df", "name": "network-vif-plugged", "status": "completed", "tag": "25665116-9189-467a-8aa2-fed12c932b37"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:38.720084 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18e3bce4-19b0-45fd-97e0-c777b6cd56ab req-2865a716-89b4-422c-b841-d2993f5c3107 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:38.722136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18e3bce4-19b0-45fd-97e0-c777b6cd56ab req-2865a716-89b4-422c-b841-d2993f5c3107 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:38.723288 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18e3bce4-19b0-45fd-97e0-c777b6cd56ab req-2865a716-89b4-422c-b841-d2993f5c3107 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:38.751618 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-18e3bce4-19b0-45fd-97e0-c777b6cd56ab req-2865a716-89b4-422c-b841-d2993f5c3107 service nova] Creating event network-vif-plugged:25665116-9189-467a-8aa2-fed12c932b37 for instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df on hv-cinder-86020 Oct 10 12:08:38.761541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-18e3bce4-19b0-45fd-97e0-c777b6cd56ab req-2865a716-89b4-422c-b841-d2993f5c3107 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224683 Oct 10 12:08:38.762695 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 66/121] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:38.876824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.886862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.888877 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:38.890218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8c5dccc6-0607-41ab-b6e9-ed7d3d9cf106 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.320171 Oct 10 12:08:38.891222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 56/122] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:38 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:39.119064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:39.119928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:39.129521 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.130126 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.134635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.134635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.134635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.134635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.153790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:39.155143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:39.167681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.170028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.176270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.176270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.176270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.176270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.292032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:39.316052 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c6d3a2cd-e0f7-4e29-8e0b-55c8651f1d0f tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.203618 Oct 10 12:08:39.317404 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 67/123] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:39 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:39.456844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:39.471394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d0bdf541-9136-4a0c-bd2a-0fed8d285386 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.324111 Oct 10 12:08:39.471394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 57/124] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:39 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:39.575254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:39.576312 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:39.592306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.593165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.593902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.595386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.596195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.596951 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.616097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:39.617987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:39.636484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.639323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.640894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:39.645610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:39.649064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:39.651660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:40.490811 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:40.509990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e32de8d0-69d8-4334-badd-9dd974ca285b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.942898 Oct 10 12:08:40.510658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 68/125] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:39 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:40.516121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:40.517132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:40.527547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:40.528279 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:40.528872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:40.530191 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:40.531104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:40.532307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:40.723294 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:40.734472 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-061657e2-9c03-4c28-8174-0d09c6182e79 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 1.129570 Oct 10 12:08:40.735100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 58/126] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:39 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:40.753952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:40.755166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:40.769431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:40.770012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:40.771150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:40.772721 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:40.773191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:40.773624 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.015658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:41.025658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:41.026914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:41.028283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e65852e9-ce08-4f8f-86ff-98cd23ec93e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.516082 Oct 10 12:08:41.043786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 69/127] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:40 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:41.053066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:41.054336 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:41.061755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.062265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.062729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.064063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.064726 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.065306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.225633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:41.239245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0952cc88-8392-4741-9de2-e19ad63af781 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.498765 Oct 10 12:08:41.245607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 59/128] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:40 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:41.426102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:41.439488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0a05f2c8-40da-4e4e-b597-63ed3625ca96 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.394434 Oct 10 12:08:41.440317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 70/129] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:41 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:41.559351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:41.561177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:41.576294 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.577500 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.578549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.579997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.581417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.582303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.779850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:41.782182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:41.794232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.795152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.795994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.798212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:41.799004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:41.799638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:41.889604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:41.902712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-109f6aac-f87e-4f39-8137-fda3dbd5d847 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.353480 Oct 10 12:08:41.903977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 60/130] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:41 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:42.058577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:42.059613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:42.064986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:42.066603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.067206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.067711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.069075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.069746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.070360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.081437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e38472cd-5c53-460a-95ca-d2dc1391d102 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.306493 Oct 10 12:08:42.082536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 71/131] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:41 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:42.167709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-b230f53a-d331-45c6-b1b0-7cce02b3904c req-c9a38d7a-1c0b-4c86-871d-0cb474f7b2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d92bcf3-e567-46a0-a87e-ab1f89a16842", "name": "network-vif-plugged", "status": "completed", "tag": "baa47217-65c4-4e53-be16-7c13a9be2c74"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:42.197453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b230f53a-d331-45c6-b1b0-7cce02b3904c req-c9a38d7a-1c0b-4c86-871d-0cb474f7b2aa service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.197979 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b230f53a-d331-45c6-b1b0-7cce02b3904c req-c9a38d7a-1c0b-4c86-871d-0cb474f7b2aa service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.198603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b230f53a-d331-45c6-b1b0-7cce02b3904c req-c9a38d7a-1c0b-4c86-871d-0cb474f7b2aa service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.217279 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-b230f53a-d331-45c6-b1b0-7cce02b3904c req-c9a38d7a-1c0b-4c86-871d-0cb474f7b2aa service nova] Creating event network-vif-plugged:baa47217-65c4-4e53-be16-7c13a9be2c74 for instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 on hv-cinder-86020 Oct 10 12:08:42.223010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-b230f53a-d331-45c6-b1b0-7cce02b3904c req-c9a38d7a-1c0b-4c86-871d-0cb474f7b2aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062659 Oct 10 12:08:42.223625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 72/132] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:08:42.261241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:42.262175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:42.269857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.270721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.271417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.272517 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.273275 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.273906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.303762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:42.338715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:42.348676 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:42.356376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ab938a8d-17a8-4d3d-9016-41242264dc24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.303307 Oct 10 12:08:42.359375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 61/133] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:42 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:42.467799 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:42.469197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:42.489503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.490351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.491136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.492537 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.493242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.493905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.505514 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:42.520329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e88f6874-8a99-4ac1-bc4f-28ee43a27552 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.263880 Oct 10 12:08:42.522166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 73/134] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:42 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:42.779931 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:42.798139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ad1f798f-0aaf-4b1b-9a77-f3cd9b07b12c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.336738 Oct 10 12:08:42.800751 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 62/135] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:42 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:42.943708 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:42.944745 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:42.966492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.968033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.968788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:42.970120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:42.970803 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:42.971727 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:43.133816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:43.137952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:43.170737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:43.171616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:43.172416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:43.173669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:43.174433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:43.182599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:43.496601 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:43.530816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6187d2e9-7b41-4403-9f95-0c5d7f82d1b9 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.593210 Oct 10 12:08:43.542451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 74/136] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:42 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:43.579676 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:43.581342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:43.593895 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:43.597236 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:43.598523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:43.600387 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:43.601936 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:43.603979 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:43.605281 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:43.701880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:43.714640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-07be8d5e-6d77-46c8-9fe2-2a73c265f8b0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.594696 Oct 10 12:08:43.719137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 63/137] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:43 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:43.723334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:43.724782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:43.752631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:43.753142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:43.753645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:43.754949 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:43.757111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:43.757561 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.045658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:44.080537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:44.086164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:44.091272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b50d3e99-d88f-4771-a662-6cc494bebca6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.541738 Oct 10 12:08:44.092860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 75/138] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:43 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:44.105705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:44.107336 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:44.120910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:44.122381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:44.123702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.125893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:44.127426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:44.128784 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.212302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:44.232925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f33e96d9-59c2-4237-9b54-affac5b2d447 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.515816 Oct 10 12:08:44.233775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 64/139] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:43 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:44.283725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-028adeab-971b-4c90-98ec-d1661bac09af req-9a3bc407-a4c9-45eb-b589-75cd2a57101f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a693f249-110a-4836-a0db-7c668d53a918", "name": "network-vif-plugged", "status": "completed", "tag": "7952dcbe-5751-4c3a-ad46-5f684e765d16"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:44.303380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-028adeab-971b-4c90-98ec-d1661bac09af req-9a3bc407-a4c9-45eb-b589-75cd2a57101f service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:44.304451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-028adeab-971b-4c90-98ec-d1661bac09af req-9a3bc407-a4c9-45eb-b589-75cd2a57101f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:44.305205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-028adeab-971b-4c90-98ec-d1661bac09af req-9a3bc407-a4c9-45eb-b589-75cd2a57101f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.322925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-028adeab-971b-4c90-98ec-d1661bac09af req-9a3bc407-a4c9-45eb-b589-75cd2a57101f service nova] Creating event network-vif-plugged:7952dcbe-5751-4c3a-ad46-5f684e765d16 for instance a693f249-110a-4836-a0db-7c668d53a918 on hv-cinder-86020 Oct 10 12:08:44.328567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-028adeab-971b-4c90-98ec-d1661bac09af req-9a3bc407-a4c9-45eb-b589-75cd2a57101f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049775 Oct 10 12:08:44.329191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 65/140] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:08:44.393812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:44.403588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-eb2bd22e-0522-47e3-a1a0-3baf9348ca2f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.308818 Oct 10 12:08:44.411883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 76/141] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:44 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:44.589759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:44.590715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:44.597629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:44.598257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:44.598746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.599493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:44.599992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:44.600511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.761751 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:44.762312 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:44.769555 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:44.770049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:44.770490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.771791 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:44.772314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:44.772747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:44.774991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:44.789953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b0900c43-e48a-41e5-abd9-dcf662de24b5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.209816 Oct 10 12:08:44.791424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 66/142] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:44 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:44.949834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:44.966837 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d190fe8c-77f1-4787-b4d1-7221835db110 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.209692 Oct 10 12:08:44.968195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 77/143] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:44 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:45.155813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:45.156938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:45.164516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.169517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.169517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:45.169517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.169517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.170138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:45.276643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:45.277692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:45.291063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.291942 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.296730 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:45.296730 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.296730 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.296730 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:45.410576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:45.427978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:45.431700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:45.434079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-aacb02b3-aa89-4d6d-bc1c-1483fc7207fc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.284645 Oct 10 12:08:45.435187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 67/144] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:45 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:45.444762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:45.445957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:45.459508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.460380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.463942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:45.465290 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.467930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.471146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:45.522195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:45.536673 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cd32b7d1-01f0-4e35-b57b-ee1b48e5499e tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.268473 Oct 10 12:08:45.537662 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 78/145] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:45 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:45.683339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:45.700000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-56093db0-9217-426a-ade0-8b6a97d8a6c4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.262595 Oct 10 12:08:45.701026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 68/146] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:45 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:45.821594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:45.823482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:45.838327 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.839891 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.841247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:45.842397 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:45.843668 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:45.844301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.003556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:46.004382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:46.018485 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.019010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.019913 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.026274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.027288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.027816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.060539 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:46.216050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:46.235067 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4746d0f7-15a0-4536-b45d-eebb2b8c35ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.421205 Oct 10 12:08:46.243153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 79/147] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:45 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:46.309553 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:46.340972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e2859ab3-853a-4cf1-9e45-834de573fd7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.344372 Oct 10 12:08:46.342493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 69/148] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:45 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:46.467065 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:46.476067 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:46.488886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.490961 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.492578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.493575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.500013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.501638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.580359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:46.581937 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:46.591606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.592667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.593210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.594087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.594948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.595728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.790157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:46.803627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:46.806823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:46.809008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5e5f459b-39d0-4b4e-9866-858e27fd7251 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.350769 Oct 10 12:08:46.810055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 80/149] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:46 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:46.819441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:46.821013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:46.832781 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.834595 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.834990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.836155 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:46.837045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:46.837786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:46.857133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:46.870441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3d20f12a-62e2-4958-a76c-6fd329ef5263 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.297929 Oct 10 12:08:46.871694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 70/150] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:46 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:47.273749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:47.274900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:47.287362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.288057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.289163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:47.291800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.292922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.294964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:47.363365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:47.376450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2ed1f9c7-abc9-4a6a-bc06-8835cc5c7841 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.564249 Oct 10 12:08:47.378252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 81/151] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:46 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:47.384512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:47.385840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:47.399948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.399948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.400698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:47.401998 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.402852 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.403626 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:47.686874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:47.706487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ea56f66b-bb88-4e49-aeb8-95fcb7d9fd8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.441070 Oct 10 12:08:47.752479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:47.772657 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 71/152] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:47 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:47.805992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f0a5477d-bcdd-4208-9543-01c2b3a7d412 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.425937 Oct 10 12:08:47.819934 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 82/153] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:47 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:47.849773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:47.855779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:47.887526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.887526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.887526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:47.887526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.888331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.890467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:47.917999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:47.921888 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:47.926529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.927684 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.928211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:47.929133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:47.929731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:47.930376 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:48.331972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:48.349660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:48.355474 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:48.356905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:48.358817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:48.360365 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c805675d-5082-467d-9700-0dbe99e5ebba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.519128 Oct 10 12:08:48.361758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 72/154] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:47 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:48.380390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a6da9d8e-504c-47a4-bf24-52b533d2f6b4 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1314 microversion: 2.1 time: 0.466079 Oct 10 12:08:48.381495 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 83/155] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:47 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:48.435270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:48.436518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:48.456767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:48.459491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:48.462830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:48.464571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:48.465753 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:48.467726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:48.777790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:48.778578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:48.802507 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:48.810646 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:48.813107 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:48.815089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:48.820567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-24ae7d61-d19a-4432-a317-6cf02b0cd1c5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.401899 Oct 10 12:08:48.820880 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:48.821649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:48.822236 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:48.825622 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 73/156] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:48 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:48.861116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:48.861116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:48.884512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:48.888616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:48.889903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:48.890998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:48.894215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:48.895475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:48.898342 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:49.105701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:49.116143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f32779df-8c76-475d-bffc-3d771633ccb7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.359548 Oct 10 12:08:49.116752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 84/157] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:48 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:49.122421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-e749e54b-6ee2-49a4-94db-0bf53ce1531e req-aa22068b-7d46-4f79-a3b4-da3e89c20af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c0121a-4f1a-4265-9efd-5a969d73bb7e", "name": "network-vif-plugged", "status": "completed", "tag": "63d53b17-0e7f-4e84-aa0c-4d6908cd174a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:49.133898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-e749e54b-6ee2-49a4-94db-0bf53ce1531e req-aa22068b-7d46-4f79-a3b4-da3e89c20af8 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:49.134392 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-e749e54b-6ee2-49a4-94db-0bf53ce1531e req-aa22068b-7d46-4f79-a3b4-da3e89c20af8 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:49.134887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-e749e54b-6ee2-49a4-94db-0bf53ce1531e req-aa22068b-7d46-4f79-a3b4-da3e89c20af8 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:49.158565 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-e749e54b-6ee2-49a4-94db-0bf53ce1531e req-aa22068b-7d46-4f79-a3b4-da3e89c20af8 service nova] Creating event network-vif-plugged:63d53b17-0e7f-4e84-aa0c-4d6908cd174a for instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e on hv-cinder-86020 Oct 10 12:08:49.166006 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-e749e54b-6ee2-49a4-94db-0bf53ce1531e req-aa22068b-7d46-4f79-a3b4-da3e89c20af8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047408 Oct 10 12:08:49.166762 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 85/158] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:49.245014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:49.253996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1d69125b-6f7c-4afd-bb3a-1666708e95ad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.417061 Oct 10 12:08:49.254570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 74/159] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:48 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:49.426116 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:49.426944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:49.434130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:49.434651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:49.435120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:49.443293 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:49.443293 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:49.443293 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:49.443566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:49.443566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:49.448650 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:49.449162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:49.449595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:49.450313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:49.451047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:49.451508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:49.656537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:49.668014 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:49.669538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:49.670748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-dde05ebb-2e65-4857-8e49-640cc1e06f2e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.249951 Oct 10 12:08:49.671529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 86/160] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:49 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:08:49.674054 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:49.685685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-19e1b540-61a5-4322-86bf-6a0201f96ec1 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1502 microversion: 2.1 time: 0.247582 Oct 10 12:08:49.686347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 75/161] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:49 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1502 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:08:49.852023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:49.852840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:49.859392 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:49.860310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:49.860784 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:49.861870 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:49.862552 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:49.863008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:50.146693 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:50.147821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:50.165974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:50.167326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:50.168454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:50.170654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:50.171805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:50.172857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:50.490550 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:50.499848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7765e701-c408-4da0-b730-2c15185f1a95 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.652482 Oct 10 12:08:50.500605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 87/162] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:49 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:50.508971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:50.514985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:50.522124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:50.523037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:50.523926 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:50.525242 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:50.526118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:50.526939 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:50.589885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:50.600897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-52777f49-bb2e-4a77-913a-c3d986a00144 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.461115 Oct 10 12:08:50.601700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 76/163] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:50 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:50.699299 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:50.710504 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a8ebfb8d-e13f-4faa-b129-cb526dbbdcb6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.208387 Oct 10 12:08:50.711881 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 88/164] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:50 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:50.716725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:50.717890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:50.730425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:50.731703 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:50.732705 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:50.733965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:50.734963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:50.736010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:50.922189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:50.933049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:50.934767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:50.935942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c289aec6-fde0-4354-9ba2-d92030c3b78d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.231516 Oct 10 12:08:50.937030 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 77/165] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:50 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:08:51.298458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-67753998-1669-4ffd-87c6-87346ae549f3 req-c69dfa08-1495-46f8-8588-acc4ef974e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb9c640-3e33-4e42-a21e-cdcce980b06a", "name": "network-vif-plugged", "status": "completed", "tag": "f65861f8-ce58-4ca5-a150-dd1cbc87aba1"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:51.330720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-67753998-1669-4ffd-87c6-87346ae549f3 req-c69dfa08-1495-46f8-8588-acc4ef974e41 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.331774 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-67753998-1669-4ffd-87c6-87346ae549f3 req-c69dfa08-1495-46f8-8588-acc4ef974e41 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.332911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-67753998-1669-4ffd-87c6-87346ae549f3 req-c69dfa08-1495-46f8-8588-acc4ef974e41 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.359145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-67753998-1669-4ffd-87c6-87346ae549f3 req-c69dfa08-1495-46f8-8588-acc4ef974e41 service nova] Creating event network-vif-plugged:f65861f8-ce58-4ca5-a150-dd1cbc87aba1 for instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a on hv-cinder-86020 Oct 10 12:08:51.367538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-67753998-1669-4ffd-87c6-87346ae549f3 req-c69dfa08-1495-46f8-8588-acc4ef974e41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080729 Oct 10 12:08:51.368244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 89/166] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:51.526949 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:51.528071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:51.536138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.536669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.537336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.538082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.538545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.539030 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.630127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:51.632396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:51.644097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.644971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.645761 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.647560 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.648446 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.649214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.815693 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:51.828131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e78f5cbe-5963-4197-883e-d242a86fa085 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1322 microversion: 2.1 time: 0.305662 Oct 10 12:08:51.829208 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 78/167] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:51 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:51.865677 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:51.866643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:51.879008 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.879499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.879927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.880879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.881739 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.882329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.900110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:51.909193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0fa1e3a9-65ba-41ad-9751-4e4335927ece tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.286919 Oct 10 12:08:51.910972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 90/168] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:51 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:51.979205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:51.980642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:51.993800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:51.996838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:51.997616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:51.999054 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:52.000079 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:52.007759 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:52.391601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:52.417186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a17924b0-9d0e-4a4d-a841-6e402cbe48c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.571669 Oct 10 12:08:52.418558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 79/169] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:51 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:52.441185 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:52.452082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:52.454570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:52.456125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e347454f-614c-4014-82cc-fea00c5c9b04 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.485466 Oct 10 12:08:52.457000 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 91/170] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:51 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:08:52.883121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:52.883121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:52.893515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:52.894329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:52.895192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:52.897495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:52.898696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:52.899480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:52.952718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:52.953794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:52.960923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:52.961406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:52.961840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:52.962779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:52.964360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:52.965085 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:53.166644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:53.175655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8a6adadd-4311-405b-bcb7-5c4ff9d26599 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1517 microversion: 2.1 time: 0.303658 Oct 10 12:08:53.176421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 80/171] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:52 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:53.186266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:53.190046 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51ec3cf3-78b1-4577-ae17-c393768aa98a"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:53.193366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:53.196987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-51bc2e4e-7a93-4a93-a89d-b5ffb21b3a6d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.248429 Oct 10 12:08:53.196987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 92/172] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:52 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:53.201191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:53.201690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:53.202178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:53.202956 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:53.203418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:53.203899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:53.209802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:08:53.212473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:53.219491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:53.219953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:53.220400 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:53.221151 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:53.221600 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:53.222016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:53.338999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'flavor' on Instance uuid a693f249-110a-4836-a0db-7c668d53a918 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:08:53.796212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-23d29f2c-dd06-4598-9909-9127e5100330 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918/action" status: 200 len: 32 microversion: 2.1 time: 0.590243 Oct 10 12:08:53.805134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 93/173] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:08:53 2022] POST /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918/action => generated 32 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 12:08:53.812332 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:53.813512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:53.824586 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:53.825430 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:53.826176 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:53.827397 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:53.828456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:53.829218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:54.019181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:54.028656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a0866db2-662b-4d78-98a1-059c28c64981 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.222024 Oct 10 12:08:54.029466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 94/174] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:53 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:54.052776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:54.053828 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:54.061741 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:54.062507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:54.063205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:54.064919 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:54.065598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:54.066038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:54.254057 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:54.264510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:54.266054 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:54.273531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b85a3eb4-ae2a-4eb4-955b-477a84fe42a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.229302 Oct 10 12:08:54.274800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 95/175] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:54 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:54.279917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:54.281136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:54.288270 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:54.289111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:54.289766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:54.290847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:54.291513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:54.292226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:54.591844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:54.606900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-de57ed43-3bc1-4c8f-bb73-f13b0fa0835f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.330227 Oct 10 12:08:54.607979 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 96/176] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:54 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:54.616757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:54.618341 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:54.632818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:54.633726 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:54.634514 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:54.635709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:54.636426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:54.637122 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:55.056835 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:55.066229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-719d3368-ef19-4cd9-8be1-6e1c265a2ca1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.456491 Oct 10 12:08:55.083012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 97/177] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:54 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:55.089118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:55.089765 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:55.097237 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:55.097995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:55.099317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:55.100288 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:55.100748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:55.101352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:55.375978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:55.391403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a80e4aa6-131d-458e-a383-49ec95ccdcd0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.305966 Oct 10 12:08:55.406725 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 98/178] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:55 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:55.406725 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:55.406725 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:55.412259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:55.413420 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:55.414197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:55.415690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:55.416516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:55.417869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:55.625666 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:55.629745 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:55.636432 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:55.637934 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:55.651900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f2506e94-3587-4f61-8d49-5a24ba4793c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.245161 Oct 10 12:08:55.651900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 99/179] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:55 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:55.651900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:55.651900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:55.653099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:55.653697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:55.654230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:55.655097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:55.655651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:55.656157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:55.856626 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:55.870916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9da55e41-ae37-4415-adc1-d6ee5aee34e9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.229780 Oct 10 12:08:55.871986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 100/180] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:55 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:56.095051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:56.096216 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:56.109440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:56.110308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:56.111118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:56.112414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:56.113280 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:56.115129 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:56.493254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:56.502361 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c2ff6b3d-c294-4631-8236-46836fa548c6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.415029 Oct 10 12:08:56.502990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 101/181] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:56 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:56.510890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:56.511634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:56.519681 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:56.520111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:56.520723 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:56.521562 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:56.522099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:56.522688 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:56.834579 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:56.861099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c0e1aabc-2f9a-4405-b167-06ab14b42576 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1361 microversion: 2.1 time: 0.353939 Oct 10 12:08:56.862150 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 102/182] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:56 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:56.880624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:56.882031 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:56.889925 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:56.891368 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:56.891901 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:56.892976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:56.897240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:56.897240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:57.235047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:57.250702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:57.255985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:57.257426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ce90e0a7-3668-4318-b882-f7503e9d5add tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.388660 Oct 10 12:08:57.258627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 103/183] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:56 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:57.264654 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:57.265458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:57.273702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:57.274364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:57.275023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:57.276037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:57.276826 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:57.277398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:57.704439 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:57.721939 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e3b785b6-896d-413e-83dd-01fae9f10d27 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.460302 Oct 10 12:08:57.726945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 104/184] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:57 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:57.735422 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:57.736689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:57.748443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:57.749797 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:57.750855 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:57.752364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:57.753059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:57.753809 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:57.931394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:57.940713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-37de09c1-945f-4f87-8fa3-8276e724d238 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.215305 Oct 10 12:08:57.941528 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 105/185] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:57 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:57.947069 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:57.947725 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:57.958231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:57.959467 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:57.960252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:57.961598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:57.962383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:57.962923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:58.269953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:58.290276 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f62f419b-8284-4078-a8ce-c68830bd1c88 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1545 microversion: 2.1 time: 0.347124 Oct 10 12:08:58.291250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 106/186] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:57 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1545 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:58.302983 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:58.302983 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:58.312704 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:58.313562 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:58.314396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:58.315780 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:58.320281 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:58.320281 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:58.496929 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:58.507819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:58.509886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:58.511527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9e25329a-bd20-40df-b5a4-e2c77228be09 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.218730 Oct 10 12:08:58.512303 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 107/187] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:58 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:08:58.518525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:58.519140 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:58.525810 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:58.526359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:58.526878 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:58.527796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:58.528255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:58.528700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:58.668440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-97e74ff9-d821-4a23-9cc5-317d864b335d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154407 Oct 10 12:08:58.669691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 108/188] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:08:58 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:58.756750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:58.758261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:58.770913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:58.772219 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:58.774272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:58.775784 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:58.776937 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:58.778148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:59.289262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-242a90f5-7f53-477c-bef1-ddd17f8743df tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "POST /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.110505 Oct 10 12:08:59.296688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 81/189] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:08:53 2022] POST /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df/os-volume_attachments => generated 194 bytes in 6118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:08:59.302661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:59.308672 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:59.322041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:59.323552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:59.324245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:59.325367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:59.326320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:59.327105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:59.483757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:08:59.511164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-81848ab6-b05b-44cb-937e-be1ebe2ebfc0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.763462 Oct 10 12:08:59.513191 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 109/190] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:58 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:08:59.581218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:08:59.582328 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:08:59.600496 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:59.601834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:59.602909 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:08:59.604441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:08:59.605716 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:08:59.606769 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:00.060452 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:00.078431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1ca7e533-310f-450a-9dc2-07282efce798 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1367 microversion: 2.1 time: 0.780745 Oct 10 12:09:00.080226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 82/191] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:08:59 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1367 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:00.331524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-1b5cf6ca-2799-47b8-a226-090f8b9524d9 req-95d9b36c-a637-4b49-a959-64ae8c9c5a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51573a-beab-4197-840e-a9427a52e273", "name": "network-vif-plugged", "status": "completed", "tag": "98e81f6a-0ff4-4344-ab00-e77663d7f2cf"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:00.366403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-1b5cf6ca-2799-47b8-a226-090f8b9524d9 req-95d9b36c-a637-4b49-a959-64ae8c9c5a19 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:00.367626 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-1b5cf6ca-2799-47b8-a226-090f8b9524d9 req-95d9b36c-a637-4b49-a959-64ae8c9c5a19 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:00.370338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-1b5cf6ca-2799-47b8-a226-090f8b9524d9 req-95d9b36c-a637-4b49-a959-64ae8c9c5a19 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:00.402297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-1b5cf6ca-2799-47b8-a226-090f8b9524d9 req-95d9b36c-a637-4b49-a959-64ae8c9c5a19 service nova] Creating event network-vif-plugged:98e81f6a-0ff4-4344-ab00-e77663d7f2cf for instance 3e51573a-beab-4197-840e-a9427a52e273 on hv-cinder-86020 Oct 10 12:09:00.413508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-1b5cf6ca-2799-47b8-a226-090f8b9524d9 req-95d9b36c-a637-4b49-a959-64ae8c9c5a19 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102911 Oct 10 12:09:00.416119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 83/192] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:00.417596 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:00.451495 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:00.459819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:00.461896 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e98dae1c-f1bb-4c73-af11-5a5e73b81fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.901019 Oct 10 12:09:00.472287 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 110/193] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:08:59 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:09:00.570030 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:00.579283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:00.600811 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:00.608616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:00.626601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:00.638317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:00.646635 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:00.647859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:01.126620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:01.129033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:01.138814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:01.140022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:01.146009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:01.146009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:01.146009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:01.146009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:01.471994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:01.471994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1704f28d-4a99-439a-bf19-24366e253a63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.916525 Oct 10 12:09:01.471994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 84/194] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:00 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:01.547017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:01.547017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:01.547017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:01.547017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:01.548176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:01.548176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:01.548176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:01.548176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:01.549138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:01.971533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:01.992718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-68a2b772-fc32-4d73-93ba-25998ae2ef18 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1557 microversion: 2.1 time: 0.874637 Oct 10 12:09:02.010861 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 111/195] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:01 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1557 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:02.044994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:02.045923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:02.057423 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:02.058227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:02.059317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:02.060915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:02.061749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:02.062768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:02.094631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:02.104421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:02.110818 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:02.112187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-558021dc-0d36-4218-9a47-e9dfe9767ae7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.598158 Oct 10 12:09:02.130803 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 85/196] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:09:01 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:09:02.322498 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-63e47fa8-a9e9-4fa8-941c-019b712a2c47 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.282892 Oct 10 12:09:02.334726 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 112/197] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:09:02 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-interface => generated 284 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:02.501201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:02.506553 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:02.534050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:02.540420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:02.540420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:02.543470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:02.546115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:02.549867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:02.784015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-7398194d-7056-419e-a677-85886d520877 req-2a003115-335c-4726-a7c3-4dfbc47911fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c0121a-4f1a-4265-9efd-5a969d73bb7e", "tag": "63d53b17-0e7f-4e84-aa0c-4d6908cd174a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:02.851028 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-7398194d-7056-419e-a677-85886d520877 req-2a003115-335c-4726-a7c3-4dfbc47911fd service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:02.851028 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-7398194d-7056-419e-a677-85886d520877 req-2a003115-335c-4726-a7c3-4dfbc47911fd service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:02.851028 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-7398194d-7056-419e-a677-85886d520877 req-2a003115-335c-4726-a7c3-4dfbc47911fd service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:02.927261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-7398194d-7056-419e-a677-85886d520877 req-2a003115-335c-4726-a7c3-4dfbc47911fd service nova] Creating event network-changed:63d53b17-0e7f-4e84-aa0c-4d6908cd174a for instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e on hv-cinder-86020 Oct 10 12:09:02.941253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:02.960705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-7398194d-7056-419e-a677-85886d520877 req-2a003115-335c-4726-a7c3-4dfbc47911fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185092 Oct 10 12:09:02.960806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9db0d95a-1943-4298-b4a7-876f5155d939 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.464474 Oct 10 12:09:02.960898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 113/198] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:02.960980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 86/199] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:02 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:03.165541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:03.166752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:03.180038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:03.181235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:03.182576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:03.184381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:03.200549 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:03.202038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:03.596454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:03.609300 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:03.617042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:03.618297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f878ee5c-7c3e-4b82-b10d-84506d85ae5c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1408 microversion: 2.20 time: 0.460968 Oct 10 12:09:03.640016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 114/200] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:09:03 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:09:03.998184 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:03.999149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:04.008788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:04.012210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:04.012210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:04.012210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:04.012210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:04.012583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:04.333761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:04.352495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-324ab32f-6f78-409b-aa5b-efbedc6d495a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.358041 Oct 10 12:09:04.370615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 87/201] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:03 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:04.652531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:04.653190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:04.660372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:04.661643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:04.662247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:04.662992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:04.663532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:04.664128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:04.838315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-d44bc57b-0733-4785-87e7-37be3e4f41e1 req-e9dc022f-4217-4860-88c2-d5be705cb911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb9c640-3e33-4e42-a21e-cdcce980b06a", "tag": "f65861f8-ce58-4ca5-a150-dd1cbc87aba1"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:04.890110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d44bc57b-0733-4785-87e7-37be3e4f41e1 req-e9dc022f-4217-4860-88c2-d5be705cb911 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:04.891373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d44bc57b-0733-4785-87e7-37be3e4f41e1 req-e9dc022f-4217-4860-88c2-d5be705cb911 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:04.895706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d44bc57b-0733-4785-87e7-37be3e4f41e1 req-e9dc022f-4217-4860-88c2-d5be705cb911 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:04.917860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-d44bc57b-0733-4785-87e7-37be3e4f41e1 req-e9dc022f-4217-4860-88c2-d5be705cb911 service nova] Creating event network-changed:f65861f8-ce58-4ca5-a150-dd1cbc87aba1 for instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a on hv-cinder-86020 Oct 10 12:09:04.930844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-d44bc57b-0733-4785-87e7-37be3e4f41e1 req-e9dc022f-4217-4860-88c2-d5be705cb911 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102365 Oct 10 12:09:04.935457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 88/202] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:04.964827 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:04.991049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:04.993196 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:04.995086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0318219c-bc27-4ef8-bf75-63c0bbd4c660 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1601 microversion: 2.20 time: 0.349358 Oct 10 12:09:04.995748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 115/203] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:09:04 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1601 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:09:05.022239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:05.023152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:05.032130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:05.033953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:05.034521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:05.036637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:05.037254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:05.037962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:05.157402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-afee5b24-3888-4e9c-9ffd-0fd97a665306 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.140237 Oct 10 12:09:05.158704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 89/204] 10.222.0.46 () {60 vars in 1316 bytes} [Mon Oct 10 12:09:05 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:09:05.397657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:05.398297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:05.410707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:05.410707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:05.410707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:05.411469 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:05.412118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:05.412560 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:05.642713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:05.653458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-62cff0b2-144b-4084-9d64-7ec6474b44e4 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.260713 Oct 10 12:09:05.655155 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 116/205] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:05 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:06.698118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:06.700606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:06.712527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:06.714567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:06.714856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:06.716503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:06.718052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:06.719197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:06.971091 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-48c1e414-a66d-43c8-b3c0-f7c070595a1f req-59055dd8-9fc9-4c59-9e3f-75ea47221298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e51573a-beab-4197-840e-a9427a52e273", "tag": "98e81f6a-0ff4-4344-ab00-e77663d7f2cf"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:06.988507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-48c1e414-a66d-43c8-b3c0-f7c070595a1f req-59055dd8-9fc9-4c59-9e3f-75ea47221298 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:07.001435 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-48c1e414-a66d-43c8-b3c0-f7c070595a1f req-59055dd8-9fc9-4c59-9e3f-75ea47221298 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:07.006005 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-48c1e414-a66d-43c8-b3c0-f7c070595a1f req-59055dd8-9fc9-4c59-9e3f-75ea47221298 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:07.056944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-48c1e414-a66d-43c8-b3c0-f7c070595a1f req-59055dd8-9fc9-4c59-9e3f-75ea47221298 service nova] Creating event network-changed:98e81f6a-0ff4-4344-ab00-e77663d7f2cf for instance 3e51573a-beab-4197-840e-a9427a52e273 on hv-cinder-86020 Oct 10 12:09:07.078019 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-48c1e414-a66d-43c8-b3c0-f7c070595a1f req-59055dd8-9fc9-4c59-9e3f-75ea47221298 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112894 Oct 10 12:09:07.080247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 117/206] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:09:07.167849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:07.187542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8fbf6757-d2b2-4f6e-9fee-5d32a639323b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.497737 Oct 10 12:09:07.190000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 90/207] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:06 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:08.216007 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:08.217079 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:08.231161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.236602 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.237065 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.237913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.238381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.239437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.277748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:08.564769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:08.565741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:08.577411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:08.589794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.589794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.589794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.589794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:08.590183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:08.590183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:08.605672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-019f6f5e-95f3-43a0-92f4-c94c59d13514 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.394545 Oct 10 12:09:08.606636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 118/208] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:08 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:08.647869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:09:09.191613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7d827e09-5fda-4024-8bee-b76b53de1036 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 204 len: 0 microversion: 2.1 time: 0.633281 Oct 10 12:09:09.192953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 91/209] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:09:08 2022] DELETE /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:09:09.201944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:09.202610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:09.209763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:09.210261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:09.210739 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:09.211506 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:09.211971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:09.212457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:09.402262 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:09.411813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-568de092-2bc7-4126-bfc8-eea152d95ad9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.213849 Oct 10 12:09:09.412411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 119/210] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:09 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:09.648292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:09.649014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:09.656602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:09.657087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:09.657519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:09.658225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:09.658698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:09.659126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:09.805980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:09.814218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-655bb8c4-3858-453a-84ec-0c4fae8f8447 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.170507 Oct 10 12:09:09.814849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 92/211] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:09 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:10.435072 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:10.435682 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:10.442697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:10.443188 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:10.443623 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:10.444330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:10.444787 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:10.445284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:10.616171 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:10.625231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c817c514-93fe-4fd0-875c-7e0a15d5fa42 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.194151 Oct 10 12:09:10.625836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 120/212] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:10 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:10.837788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:10.838559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:10.845423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:10.845923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:10.846369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:10.847132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:10.847587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:10.848018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:11.000128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:11.015300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2f7b52b3-d643-4cd3-be56-f816703fb519 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.180946 Oct 10 12:09:11.016247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 93/213] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:10 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:11.649709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:11.650371 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:11.656804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:11.657359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:11.657794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:11.658490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:11.658968 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:11.659393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:11.799846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:11.808522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8194f526-8b2c-4f9a-a571-a01e100291c7 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.163574 Oct 10 12:09:11.809091 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 121/214] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:11 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:12.052164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:12.052985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:12.059808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:12.060302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:12.060773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:12.061491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:12.061946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:12.062373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:12.194161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:12.201883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3f21aa9d-3819-4313-a646-82cb443a4e63 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.153762 Oct 10 12:09:12.202461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 94/215] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:12 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:12.831817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:12.832550 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:12.838710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:12.839197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:12.839635 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:12.840330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:12.840781 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:12.841234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:12.980868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:12.989781 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-308c1f74-6871-4ab7-a227-9d833682a576 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.161273 Oct 10 12:09:12.990423 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 122/216] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:12 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:13.225518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:13.226045 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:13.232765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:13.233250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:13.233683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:13.234372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:13.234857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:13.235271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:13.366817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:13.374544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4d00f6a6-ac25-44f8-b548-2bd433834e8b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.153998 Oct 10 12:09:13.375148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 95/217] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:13 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:14.012801 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:14.013391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:14.019623 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:14.020116 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:14.020551 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:14.021256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:14.021715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:14.022145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:14.162366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:14.171297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1e4041c6-cd4f-421c-ba2e-4f3746436f3d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.162457 Oct 10 12:09:14.171873 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 123/218] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:14 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:14.397592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:14.398263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:14.405015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:14.405484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:14.405915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:14.406604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:14.407085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:14.407504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:14.544516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:14.553136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bf08182d-39a7-4477-b1b3-b05c2a32418f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.159568 Oct 10 12:09:14.553715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 96/219] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:14 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:15.197643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:15.198349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:15.202076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=97 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:15.206603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:15.207280 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:15.208731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:15.209741 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:15.210358 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:15.211069 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:15.360090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:15.368872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cc110817-616b-479e-a56c-ae023946c26b tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.177609 Oct 10 12:09:15.369459 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 124/220] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:15 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:15.576223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:15.576846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:15.584138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:15.584708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:15.585083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:15.585808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:15.586276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:15.586745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:15.750254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:15.762161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-145d49e0-dab7-4aa9-a4da-aa92bbc7c28f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.189820 Oct 10 12:09:15.767316 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 97/221] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:15 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:16.395788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:16.396855 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:16.407155 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:16.407946 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:16.408652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:16.409834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:16.411251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:16.411978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:16.594244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:16.603534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-593d5abd-13f4-450c-b449-c871488792ac tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.213960 Oct 10 12:09:16.605721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 125/222] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:16 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:16.785541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:16.786387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:16.793156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:16.793706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:16.794193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:16.800024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:16.800024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:16.800024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:16.981186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:16.990593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2d8efec4-ed4c-47e7-9d84-1957d06d02a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.208938 Oct 10 12:09:16.991507 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 98/223] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:16 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:17.628664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:17.630554 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:17.642354 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:17.650592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:17.650592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:17.650592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:17.650592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:17.651023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:17.808990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:17.818562 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d178fa0c-8d78-4888-a015-644dacfa4764 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1554 microversion: 2.1 time: 0.194642 Oct 10 12:09:17.819364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 126/224] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:17 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:17.968253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-aa237c41-a341-43eb-8196-02bb7122fe19 req-c7947b48-7da2-436b-9c37-35da00fc93ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cef35a8-bca8-406f-b7e1-ffaaa71927df", "name": "network-vif-deleted", "tag": "25665116-9189-467a-8aa2-fed12c932b37"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:17.986760 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-aa237c41-a341-43eb-8196-02bb7122fe19 req-c7947b48-7da2-436b-9c37-35da00fc93ec service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:17.987784 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-aa237c41-a341-43eb-8196-02bb7122fe19 req-c7947b48-7da2-436b-9c37-35da00fc93ec service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:17.988599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-aa237c41-a341-43eb-8196-02bb7122fe19 req-c7947b48-7da2-436b-9c37-35da00fc93ec service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.012355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-aa237c41-a341-43eb-8196-02bb7122fe19 req-c7947b48-7da2-436b-9c37-35da00fc93ec service nova] Creating event network-vif-deleted:25665116-9189-467a-8aa2-fed12c932b37 for instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df on hv-cinder-86020 Oct 10 12:09:18.018898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:18.019636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:18.021114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-aa237c41-a341-43eb-8196-02bb7122fe19 req-c7947b48-7da2-436b-9c37-35da00fc93ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055528 Oct 10 12:09:18.022133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 99/225] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:09:18.036069 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:18.037779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:18.039720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.040798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:18.043876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:18.044672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.217879 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:18.227849 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a25fd63b-4dab-4ecb-a2c5-f0d95f8e8d1e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.216159 Oct 10 12:09:18.229049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 127/226] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:18 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:18.846469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:18.847544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:18.859093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:18.859695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:18.860378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.861297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:18.861985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:18.862715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:18.933111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:18.943281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bd9c974c-0017-479d-ae55-d9cbb18fb3ea tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1345 microversion: 2.1 time: 0.101325 Oct 10 12:09:18.944416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 100/227] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:18 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:19.253899 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:19.255008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:19.262413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.263056 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.263608 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:19.264335 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.264805 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.265237 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:19.503065 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:19.512426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c3cd8990-960a-450f-b97a-95322fded03e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.262857 Oct 10 12:09:19.512426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 128/228] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:19 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:19.966480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:19.967161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:19.971156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:19.974884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.975381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.975825 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:19.976603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:19.977476 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:19.978084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:20.043947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:20.044465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:20.045099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:20.045720 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lazy-loading 'fault' on Instance uuid 8cef35a8-bca8-406f-b7e1-ffaaa71927df {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:09:20.053436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:20.098281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc73e7bcf19443a940b6969e1be8e47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87226283dcb4d6fb203cc5e06cf13b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:20.109816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dcafce59-b35c-48df-b53a-fa606d90749d tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 200 len: 1350 microversion: 2.1 time: 0.146885 Oct 10 12:09:20.114717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 101/229] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:19 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:20.536289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:20.537139 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:20.543733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:20.544227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:20.544669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:20.545383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:20.545840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:20.546423 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:20.699207 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:20.707584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2bbd4b0a-5326-480f-8803-9d1215a36021 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.175524 Oct 10 12:09:20.708468 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 129/230] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:20 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:21.135603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:21.136697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:21.146225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:21.147769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:21.147769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:21.148518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:21.149050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:21.149607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:21.165867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] HTTP exception thrown: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Request method failure captured: Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df HTTP/1.1 Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsdLqoaRHZlnFc7CwG0siq8Hh72U82aUhg6AA9OJI5q1a3MjAh-5Imr7MYqR2AY-p5dxZuFrZqKtod3SLNgPrHVTUpyo6YMvWr_mABWgJ85zdnFBe1wN1HKdGqr-_Ot-v4mSg2H88Oi8i1nrKptVDIZJGtBAZFU6rV6EVNa_PmJDFQ Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:09:21.170530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f87226283dcb4d6fb203cc5e06cf13b2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 6bc73e7bcf19443a940b6969e1be8e47 Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.173112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '8cef35a8-bca8-406f-b7e1-ffaaa71927df'} Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:21.174691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.192187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Returning 404 to user: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:21.192187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4ab29c33-2545-46d1-af59-b9072ef7ceae tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 404 len: 111 microversion: 2.1 time: 0.041773 Oct 10 12:09:21.192187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 102/231] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:21 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:09:21.312706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:21.315713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:21.325834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:21.326742 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:21.327543 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:21.328821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:21.329684 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:21.330726 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:21.347584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] HTTP exception thrown: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Request method failure captured: Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df/os-volume_attachments HTTP/1.1 Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAsdLqoaRHZlnFc7CwG0siq8Hh72U82aUhg6AA9OJI5q1a3MjAh-5Imr7MYqR2AY-p5dxZuFrZqKtod3SLNgPrHVTUpyo6YMvWr_mABWgJ85zdnFBe1wN1HKdGqr-_Ot-v4mSg2H88Oi8i1nrKptVDIZJGtBAZFU6rV6EVNa_PmJDFQ Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:09:21.353457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f87226283dcb4d6fb203cc5e06cf13b2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: 6bc73e7bcf19443a940b6969e1be8e47 Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.360363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'server_id': '8cef35a8-bca8-406f-b7e1-ffaaa71927df'} Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:21.361087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:21.362346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:21.364273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Returning 404 to user: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:21.364273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-09d09e0f-4753-464f-ac99-3a27a43e46b9 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050103 Oct 10 12:09:21.364273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 130/232] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:09:21 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:21.737570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:21.739405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:21.775456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:21.776223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:21.777442 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:21.778415 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:21.779946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:21.780672 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:22.018644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:22.027629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fff9227d-2964-48b5-a360-f6fb578a90a2 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.300282 Oct 10 12:09:22.028238 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 103/233] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:21 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:22.816947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:22.817648 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:22.824169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:22.824735 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:22.825090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:22.826771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:22.826771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:22.826771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:22.843612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] HTTP exception thrown: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Request method failure captured: Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: DELETE /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df HTTP/1.1 Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAsdLqoaRHZlnFc7CwG0siq8Hh72U82aUhg6AA9OJI5q1a3MjAh-5Imr7MYqR2AY-p5dxZuFrZqKtod3SLNgPrHVTUpyo6YMvWr_mABWgJ85zdnFBe1wN1HKdGqr-_Ot-v4mSg2H88Oi8i1nrKptVDIZJGtBAZFU6rV6EVNa_PmJDFQ Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:09:22.843815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f87226283dcb4d6fb203cc5e06cf13b2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: 6bc73e7bcf19443a940b6969e1be8e47 Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.847382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': '8cef35a8-bca8-406f-b7e1-ffaaa71927df'} Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:22.849320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.851456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.854793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Returning 404 to user: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:22.854793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-dfc04544-a80b-40d7-89b6-611b57a07924 tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 404 len: 111 microversion: 2.1 time: 0.032286 Oct 10 12:09:22.854793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 131/234] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:09:22 2022] DELETE /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:22.857224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:22.858079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] [instance: 8cef35a8-bca8-406f-b7e1-ffaaa71927df] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:22.865451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:22.865940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:22.866562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:22.867313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:22.867771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:22.868201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:22.883052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] HTTP exception thrown: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Request method failure captured: Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df HTTP/1.1 Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsdLqoaRHZlnFc7CwG0siq8Hh72U82aUhg6AA9OJI5q1a3MjAh-5Imr7MYqR2AY-p5dxZuFrZqKtod3SLNgPrHVTUpyo6YMvWr_mABWgJ85zdnFBe1wN1HKdGqr-_Ot-v4mSg2H88Oi8i1nrKptVDIZJGtBAZFU6rV6EVNa_PmJDFQ Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:09:22.884730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f87226283dcb4d6fb203cc5e06cf13b2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f87226283dcb4d6fb203cc5e06cf13b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: f87226283dcb4d6fb203cc5e06cf13b2 Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-DeleteServersTestJSON-343867101 Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 6bc73e7bcf19443a940b6969e1be8e47 Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-DeleteServersTestJSON-343867101-project Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.887384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '8cef35a8-bca8-406f-b7e1-ffaaa71927df'} Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:22.888758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. Oct 10 12:09:22.890341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:09:22.892708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] Returning 404 to user: Instance 8cef35a8-bca8-406f-b7e1-ffaaa71927df could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:22.892708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a8bb05d6-b767-4d6d-b877-fc2d0601586a tempest-DeleteServersTestJSON-343867101 tempest-DeleteServersTestJSON-343867101-project] 10.222.0.46 "GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df" status: 404 len: 111 microversion: 2.1 time: 0.033244 Oct 10 12:09:22.898062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 104/235] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:22 2022] GET /compute/v2.1/servers/8cef35a8-bca8-406f-b7e1-ffaaa71927df => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:09:23.051987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:23.052652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:23.059949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:23.060527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:23.060969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:23.061672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:23.062507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:23.063146 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:23.233796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:23.244384 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-773dc9dc-67a4-4fa3-8a4f-d6ebd81c4d3a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.196647 Oct 10 12:09:23.244887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 132/236] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:23 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:24.271563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:24.273050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:24.288111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:24.289450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:24.290554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:24.292081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:24.292997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:24.293718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:24.534496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:24.545019 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7d967a00-0ef1-46dd-aefb-ec448a1eb0fe tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.280619 Oct 10 12:09:24.545977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 105/237] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:24 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:25.586100 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:25.586813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:25.593501 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:25.593993 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:25.594427 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:25.595150 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:25.595594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:25.596010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:25.900795 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:25.910363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5f4575d3-5ec5-4b1d-b193-791168448b25 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.329353 Oct 10 12:09:25.911440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 133/238] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:25 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:26.942998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:26.945114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:26.957349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:26.958565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:26.959391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:26.960671 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:26.961488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:26.962065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:27.198925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:27.207960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-87b14f1d-2015-4ca9-99a3-bea1dff60b8e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.273993 Oct 10 12:09:27.208645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 106/239] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:26 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:28.232364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:28.233098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:28.240488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:28.241042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:28.241672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:28.242924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:28.243615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:28.244333 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:28.428520 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:28.436818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0f300d24-d286-4b23-a69c-671fd2eb43ed tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.208852 Oct 10 12:09:28.437403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 134/240] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:28 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:29.461455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:29.462128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:29.472010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:29.473009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:29.479159 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:29.480170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:29.480978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:29.481584 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:29.887489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:29.896217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ed102f54-a663-4539-8704-edfe97d31af9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.438769 Oct 10 12:09:29.896799 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 107/241] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:29 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:30.923455 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:30.924449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:30.933525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:30.934283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:30.940669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:30.940669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:30.940669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:30.940669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:31.094284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:31.103459 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b059e04d-b1ee-4bc2-9aff-c5c47bed5743 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.185075 Oct 10 12:09:31.104044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 135/242] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:30 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:32.127485 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:32.128102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:32.135808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:32.136341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:32.136987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:32.137709 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:32.138170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:32.138599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:32.369907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:32.379195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9d29d622-00f6-4710-a87f-f62a5db2cca3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.255590 Oct 10 12:09:32.380129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 108/243] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:32 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:33.417431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:33.418903 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:33.426526 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:33.443011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:33.443011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:33.443011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:33.443011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:33.443675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:33.452963 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:33.587042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:33.595817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1d07fdfe-9e41-46e5-9ab6-1578d3c22704 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.183235 Oct 10 12:09:33.596537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 136/244] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:33 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:34.625707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:34.627009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:34.638466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:34.639177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:34.639814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:34.640842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:34.641491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:34.642199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:34.882048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:34.891627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a72e0b0b-f91e-4f9a-8efe-8a40aa1735d7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.273586 Oct 10 12:09:34.899212 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 109/245] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:34 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:35.916558 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:35.918699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:35.930230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:35.931305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:35.932496 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:35.933420 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:35.934293 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:35.935485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:36.187039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:36.204287 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a9405539-efa9-45d3-aa1d-6e712c3db7cb tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.287100 Oct 10 12:09:36.204287 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 137/246] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:35 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:37.227560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:37.227560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:37.234419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:37.235223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:37.235888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:37.236785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:37.237424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:37.237942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:37.432928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:37.441362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c4e87e2e-fce2-4dbe-bb3d-ecc20d9fb1ca tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.220185 Oct 10 12:09:37.442169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 110/247] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:37 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:38.471323 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:38.472393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:38.480689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:38.481273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:38.481999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:38.483120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:38.483813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:38.484491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:38.685190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:38.704129 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9e3e693e-d86c-453d-a6c3-b91370c85474 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.241636 Oct 10 12:09:38.705907 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 138/248] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:38 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:39.729769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:39.730509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:39.737590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:39.738083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:39.738587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:39.739336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:39.739801 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:39.740232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:39.959451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:39.968079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9118da88-0f9d-4459-aa5d-cb88a037bf29 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1523 microversion: 2.1 time: 0.242748 Oct 10 12:09:39.968669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 111/249] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:39 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:40.996118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:40.996678 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:41.003271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:41.003766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:41.004258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:41.005227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:41.005684 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:41.006117 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:41.178597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:41.186987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-807dc0c5-1cc5-4880-9aac-08e647850c18 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1503 microversion: 2.1 time: 0.195165 Oct 10 12:09:41.196834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 139/250] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:40 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:41.230947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:41.232199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:41.249134 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:41.249134 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:41.249747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:41.251458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:41.252653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:41.253534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:41.532355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:41.540846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dc33f6df-1a39-4001-977e-6ef460c0269d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1515 microversion: 2.1 time: 0.317530 Oct 10 12:09:41.559893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 112/251] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:41 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:44.656125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:44.660103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:44.671836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:44.672653 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:44.680148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:44.680148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:44.680148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:44.680148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:44.746969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'flavor' on Instance uuid 7d92bcf3-e567-46a0-a87e-ab1f89a16842 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:09:45.190148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bc9db85f-9bd3-49f9-927d-eb8b845ef7ef tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842/action" status: 200 len: 32 microversion: 2.1 time: 0.539433 Oct 10 12:09:45.193225 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 140/252] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:09:44 2022] POST /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842/action => generated 32 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:09:45.200605 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:45.201831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:45.209253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:45.209738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:45.210169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:45.210905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:45.211891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:45.212328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:45.388482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:45.394504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6ad1364e-07d1-4b79-8adb-3dc538a60ca1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.197246 Oct 10 12:09:45.395132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 113/253] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:45 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:46.427104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:46.429690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:46.447036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=34 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:46.451749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:46.452959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:46.453754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:46.455606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:46.456792 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:46.457598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:46.727988 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:46.739172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4af3205f-2f84-4742-9b1f-2c994fee4233 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.322099 Oct 10 12:09:46.755372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 141/254] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:46 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:47.764719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:47.765574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:47.774497 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:47.775212 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:47.775850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:47.777262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:47.778025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:47.778792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:48.010379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:48.024568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eac95c60-91d2-45a4-b3e0-480d4174e4ba tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.263985 Oct 10 12:09:48.025853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 114/255] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:47 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:49.049748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:49.051162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:49.057896 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:49.058421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:49.058969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:49.059805 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:49.060340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:49.061075 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:49.283656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:49.295433 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-84cd2821-e591-4eb0-a529-a94f68ee05db tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.249752 Oct 10 12:09:49.296006 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 142/256] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:49 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:50.326875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:50.328869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:50.331631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=30 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:50.337287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:50.338089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:50.338606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:50.339442 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:50.339976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:50.340483 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:50.572730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:50.596146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7f8f4bef-fbe0-47b7-9dec-6acb446a4508 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.280167 Oct 10 12:09:50.607395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 115/257] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:50 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:50.866256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1326659118", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "networks": [{"uuid": "81f47188-f87d-4346-bd72-870978ce64be"}]}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:50.965193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] validate_networks() for [('81f47188-f87d-4346-bd72-870978ce64be', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:09:51.491483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Flavor limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:09:51.492096 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Image limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:09:51.492579 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Flavor pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:09:51.493059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Image pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:09:51.493495 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:09:51.503113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:51.503886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:51.504312 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:51.505201 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:51.505663 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:51.506078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:51.525968 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Getting quotas for project 42363f6f6a6040e5b81070350a2b7855. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:09:51.530694 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Getting quotas for user 13ac3580c0164d20994d68744d9153b8 and project 42363f6f6a6040e5b81070350a2b7855. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:09:51.544099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Going to run 1 instances... {{(pid=121298) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:09:51.546466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:09:51.641825 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:51.642559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:51.655394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:51.656293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:51.657348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:51.658658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:51.659508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:51.660285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:51.755690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bd60464c-230b-40df-acff-14f6fbe2792f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897150 Oct 10 12:09:51.757542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 143/258] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:09:51.778725 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cbd884d5-ce69-4172-9bf8-d71babbae768 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:51.782184 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cbd884d5-ce69-4172-9bf8-d71babbae768 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:51.884489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:51.892916 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c53535be-591f-4745-bc60-5bf7f84f0f04 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.256568 Oct 10 12:09:51.893771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 116/259] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:51 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:51.902834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cbd884d5-ce69-4172-9bf8-d71babbae768 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:51.909890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cbd884d5-ce69-4172-9bf8-d71babbae768 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1219 microversion: 2.1 time: 0.138987 Oct 10 12:09:51.915048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 144/260] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:51 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:52.918430 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:52.919404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:52.927563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:52.928209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:52.928722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:52.929506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:52.930023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:52.931103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:52.950829 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fa0b4514-c5b6-44ae-b01e-0d76c680aa0c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:52.951485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fa0b4514-c5b6-44ae-b01e-0d76c680aa0c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:52.968554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=85 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.066222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fa0b4514-c5b6-44ae-b01e-0d76c680aa0c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:53.079616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fa0b4514-c5b6-44ae-b01e-0d76c680aa0c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1219 microversion: 2.1 time: 0.138602 Oct 10 12:09:53.080614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 145/261] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:52 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:53.144962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:53.164695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-51230bd2-c539-4294-a4bf-1f1288106be9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.250196 Oct 10 12:09:53.167754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 117/262] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:52 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:54.104877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:54.105623 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:54.114117 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:54.114906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:54.115611 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:54.116858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:54.117732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:54.118427 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:54.192183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:54.193051 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:54.199390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:54.203407 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:54.203947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:54.204402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:54.205150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:54.205810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:54.206525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:54.208581 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-521dc943-a63d-45d3-a5b3-c0ea50d74a5d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1215 microversion: 2.1 time: 0.108897 Oct 10 12:09:54.221004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 146/263] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:54 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:54.400606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:54.408789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f62284b7-d19f-4d68-ae79-d4687b6f9fa6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.221612 Oct 10 12:09:54.409963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 118/264] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:54 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:55.233173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:55.233911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:55.240584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:55.241090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:55.241518 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:55.242211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:55.242657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:55.243111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:55.311036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:55.317641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-14af5d81-10b4-4cd9-b64b-8aa759e4142a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1271 microversion: 2.1 time: 0.088216 Oct 10 12:09:55.318259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 147/265] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:55 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:55.433100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:55.433650 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:55.441698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:55.442225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:55.442680 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:55.443407 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:55.443865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:55.444295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:55.597612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:55.606124 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-92010089-22b6-40e1-b883-b5bde6367294 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.177097 Oct 10 12:09:55.606740 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 119/266] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:55 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:56.341246 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:56.341917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:56.348660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.349147 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.349739 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.350445 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.351091 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.351777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.449075 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:56.474186 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-778d30b6-6f61-4a4c-bcae-744e2896ac87 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1271 microversion: 2.1 time: 0.135781 Oct 10 12:09:56.475344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 148/267] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:56 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:56.633679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:56.634272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:56.641118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.641600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.642031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.642764 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.643216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.644267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.805182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:56.822102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1df47382-a8e8-4c53-b2c2-59d9d35ea492 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1501 microversion: 2.1 time: 0.191798 Oct 10 12:09:56.823732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 120/268] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:56 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:56.853390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0934b7c-7f0f-48e3-8fbb-c027060162ad"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:56.856058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:56.865496 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.867255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.867255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.867500 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.868091 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.868590 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.901779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] HTTP exception thrown: Cannot 'attach_volume' instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 while it is in vm_state rescued Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Request method failure captured: Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: POST /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842/os-volume_attachments HTTP/1.1 Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 74 Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAse6dTSTQcasFgmOM7hNbdxasgbqo82IjkVxrYw2tk_rJqyxLGlSAqrgg96TLD1T8o3wQz_qR3TL3WYm3KepTG9jkOgrJiEiPrnb5-27tfxw2QaoRgf1EvzKsW3HwmQK7s9i1NsfM12drhVq6WvVFRVzCRNEMZZ_w3K-YxOc8pn98E Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:09:56.904838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_782c5fd84235487caac5f9a7e18563cb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: 45c87aa85b7d45fe8acf6f36a3d2a639 Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {"volumeAttachment": {"volumeId": "b0934b7c-7f0f-48e3-8fbb-c027060162ad"}} Oct 10 12:09:56.907914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Cannot 'attach_volume' instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 while it is in vm_state rescued Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'server_id': '7d92bcf3-e567-46a0-a87e-ab1f89a16842', 'body': {'volumeAttachment': {'volumeId': 'b0934b7c-7f0f-48e3-8fbb-c027060162ad'}}} Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:09:56.909538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 while it is in vm_state rescued Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:09:56.911972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:09:56.914523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:09:56.914523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:09:56.914523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 while it is in vm_state rescued Oct 10 12:09:56.914523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:09:56.914523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Returning 409 to user: Cannot 'attach_volume' instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 while it is in vm_state rescued {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:09:56.914523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8ca37028-4978-409a-a20d-e3782df1cf53 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061042 Oct 10 12:09:56.916289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 149/269] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:09:56 2022] POST /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 12:09:56.922869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:56.923474 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:56.931400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.931904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.933534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:56.933534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:56.933929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:56.934068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.166759 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-653378342", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "networks": [{"uuid": "435564f3-e5dd-46a9-88d6-ee2f75cdcd4e"}]}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:57.245295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-50dc4555-8b0a-4de6-9dac-fe09e3066577 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842/action" status: 202 len: 0 microversion: 2.1 time: 0.325775 Oct 10 12:09:57.249560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 121/270] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:09:56 2022] POST /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:09:57.249904 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] validate_networks() for [('435564f3-e5dd-46a9-88d6-ee2f75cdcd4e', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:09:57.254842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:57.256579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:57.265409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.271850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.273372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.274697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.276400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.277135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.525073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:57.539260 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2405f11a-af8e-42d2-b744-5c2d93331468 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1509 microversion: 2.1 time: 0.288575 Oct 10 12:09:57.544318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 122/271] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:57 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:57.548867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:57.550370 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:57.559769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.560597 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.561224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.561962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.562574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.563209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.665830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:57.685812 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1941561e-0f7a-4890-bf5c-96ed260d9eb0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1277 microversion: 2.1 time: 0.142916 Oct 10 12:09:57.686547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 123/272] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:57 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:57.872848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Flavor limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:09:57.873395 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Image limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:09:57.874182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Flavor pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:09:57.874899 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Image pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:09:57.875479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:09:57.891800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.892630 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.893394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.894928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:57.895794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:57.896616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:57.931700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Getting quotas for project 4326aa9c66954652943d3754b121bce8. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:09:57.938392 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Getting quotas for user d58683f7689a4356badd8f4bb30850a5 and project 4326aa9c66954652943d3754b121bce8. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:09:57.955030 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Going to run 1 instances... {{(pid=121298) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:09:57.958405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:09:58.100341 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fcc03ca6-2455-4656-885c-b7278df2b72d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937119 Oct 10 12:09:58.101971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 150/273] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:09:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:09:58.116193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eda3ff29-826d-41fe-be5e-8628fd0bf52e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:58.121605 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eda3ff29-826d-41fe-be5e-8628fd0bf52e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:58.213670 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eda3ff29-826d-41fe-be5e-8628fd0bf52e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:58.222610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eda3ff29-826d-41fe-be5e-8628fd0bf52e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1213 microversion: 2.1 time: 0.111495 Oct 10 12:09:58.223317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 124/274] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:58 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:58.569411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:58.570689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:58.578436 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:58.579376 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:58.580627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:58.581717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:58.582479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:58.583196 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:58.709687 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:58.710380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:58.718782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:58.719419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:58.720205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:58.720995 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:58.722192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:58.722728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:58.904456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:58.914228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-979aa2ea-00a9-4cb3-b53c-5cf1d4fd2539 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1509 microversion: 2.1 time: 0.350386 Oct 10 12:09:58.914856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 151/275] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:58 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:58.955828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:58.972258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-78f5c1c0-2dc4-4671-bc89-212bf35af183 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.265774 Oct 10 12:09:58.973267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 125/276] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:58 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:09:59.267300 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-191d474d-8e77-409f-8590-040662a20b33 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:59.271799 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-191d474d-8e77-409f-8590-040662a20b33 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:59.348506 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-191d474d-8e77-409f-8590-040662a20b33 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:09:59.360432 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-191d474d-8e77-409f-8590-040662a20b33 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1213 microversion: 2.1 time: 0.097054 Oct 10 12:09:59.361885 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 152/277] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:59 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:09:59.916929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-944d0d76-f967-41b6-afe8-46323da39539 req-f0fa81b8-60af-427d-b7eb-8a06e1901e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f411d6a5-3966-4066-83a4-5499708446b4", "tag": "5a6667d5-f54b-479b-8dc6-7057368e05a2"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:09:59.930849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-944d0d76-f967-41b6-afe8-46323da39539 req-f0fa81b8-60af-427d-b7eb-8a06e1901e06 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:59.931647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-944d0d76-f967-41b6-afe8-46323da39539 req-f0fa81b8-60af-427d-b7eb-8a06e1901e06 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:59.932693 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-944d0d76-f967-41b6-afe8-46323da39539 req-f0fa81b8-60af-427d-b7eb-8a06e1901e06 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:59.942010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:09:59.944195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:09:59.962508 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:59.963221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:59.963931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:59.964981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:09:59.965686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:09:59.966244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:09:59.969365 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-944d0d76-f967-41b6-afe8-46323da39539 req-f0fa81b8-60af-427d-b7eb-8a06e1901e06 service nova] Creating event network-changed:5a6667d5-f54b-479b-8dc6-7057368e05a2 for instance f411d6a5-3966-4066-83a4-5499708446b4 on hv-cinder-86020 Oct 10 12:09:59.978519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-944d0d76-f967-41b6-afe8-46323da39539 req-f0fa81b8-60af-427d-b7eb-8a06e1901e06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067063 Oct 10 12:09:59.979750 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 126/278] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:00.001447 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:00.002889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:00.013802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:00.015014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:00.015745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:00.017233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:00.018014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:00.019312 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:00.187487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:00.211982 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a421287f-81a6-4a31-85f8-01b59a4152a5 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1509 microversion: 2.1 time: 0.273460 Oct 10 12:10:00.217265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 153/279] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:59 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:00.256229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:00.271207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-de53939b-482e-4163-bd05-b4d21de5b323 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.277245 Oct 10 12:10:00.272344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 127/280] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:09:59 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:00.400106 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:00.400875 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:00.409145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:00.410490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:00.411339 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:00.412922 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:00.414026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:00.414834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:00.499104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:00.508367 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1fd0a534-44db-4eca-8ac3-9a114848c13c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1217 microversion: 2.1 time: 0.112767 Oct 10 12:10:00.508963 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 154/281] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:00 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:01.257938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:01.258831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:01.268839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.269403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.269835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.270579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.271310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.272060 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.308243 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:01.309536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:01.324321 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.325143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.325766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.326771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.327455 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.328042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.554479 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:01.563917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-97ae8d72-cd03-416d-9a86-cda30d54ecd9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1509 microversion: 2.1 time: 0.311221 Oct 10 12:10:01.565697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 128/282] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:01 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:01.573848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:01.574924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:01.585988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.586998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.587734 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.588566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:01.589192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:01.589798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:01.624239 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:01.629068 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:01.636206 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c553d12f-98c2-4ab7-a311-95fa2bb35c52 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.332086 Oct 10 12:10:01.637083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 155/283] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:01 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:01.683862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:01.696559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4fda319c-30c9-428e-8adb-96636315ac15 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1209 microversion: 2.1 time: 0.129695 Oct 10 12:10:01.697550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 129/284] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:01 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:02.589733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:02.590356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:02.598123 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.598627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.599291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.600032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.600664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.601512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.664291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:02.666307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:02.678519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.680541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.681400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.682603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.683108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.689637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.867856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:02.877250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d8032fb0-ef4b-494b-a77d-911bc0ce00a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1515 microversion: 2.1 time: 0.291705 Oct 10 12:10:02.878426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 156/285] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:02 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:02.883610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:02.884506 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:02.895865 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.898516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.900078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.901153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:02.905690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:02.905690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:02.946427 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:02.962943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-527a2292-090c-4d0c-af57-74709088b21c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.304058 Oct 10 12:10:02.964586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 130/286] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:02 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:03.025561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:03.056441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b0e2b8d8-a25b-455e-9eec-ad30c7a153c3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1265 microversion: 2.1 time: 0.176314 Oct 10 12:10:03.057513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 157/287] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:02 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:03.988281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:03.998471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:03.998471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:03.998471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:03.998471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:03.999148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:03.999148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:03.999148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:04.085715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:04.086337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:04.109980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:04.109980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:04.109980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:04.109980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:04.111037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:04.111037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:04.168126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:04.177387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7236e5bb-98dc-430d-90db-6b13c584248c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.193116 Oct 10 12:10:04.178148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 131/288] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:03 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:04.190645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:04.200540 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3b3dbf6e-aee1-40b7-a9ff-58e4ed0f2369 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1265 microversion: 2.1 time: 0.122841 Oct 10 12:10:04.201448 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 158/289] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:04 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:05.213071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:05.217848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:05.225798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:05.226955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:05.236156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:05.236645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:05.237109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:05.238405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:05.239482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:05.244582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:05.244582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:05.244582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:05.247118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:05.248317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:05.248806 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:05.249250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:05.331773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:05.341665 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-43335289-08ca-4ca5-adf8-444cf5ecee07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1265 microversion: 2.1 time: 0.120546 Oct 10 12:10:05.342603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 159/290] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:05 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:05.603734 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:05.613634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d72f385a-9eb3-4153-aad6-720cd1b1e532 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.413957 Oct 10 12:10:05.614421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 132/291] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:05 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:05.943165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1edb1532-6096-4939-9e21-8b6fa55a439c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'create', calling method: .version_select at 0x7f6d12b22f70>, body: {"keypair": {"name": "tempest-keypair-839708287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFYRimXyXOxDjBTvTOujb6Z6J90h6u5J+mBtSz1IdffqS/whr9smEcA1rQRt4bgXvSuPxP9GCEumicXq92FFT3//lbskyeAKJBEWuzEcnqjPf6r0wGHziVPT+IutWP9Hw=="}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:05.968309 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-1edb1532-6096-4939-9e21-8b6fa55a439c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for project 782c5fd84235487caac5f9a7e18563cb. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:10:05.976538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-1edb1532-6096-4939-9e21-8b6fa55a439c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for user 45c87aa85b7d45fe8acf6f36a3d2a639 and project 782c5fd84235487caac5f9a7e18563cb. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:10:06.097063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1edb1532-6096-4939-9e21-8b6fa55a439c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158453 Oct 10 12:10:06.097534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 160/292] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:10:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:06.368566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:06.370094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:06.382317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:06.383453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:06.384582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:06.385694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:06.386928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:06.387755 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:06.551741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:06.563806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a0d996c0-f9fa-4409-bbc2-b64f9d354c29 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1265 microversion: 2.1 time: 0.201389 Oct 10 12:10:06.565531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 133/293] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:06 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:06.658489 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:06.665213 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:06.685737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:06.688366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:06.689535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:06.692557 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:06.706620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:06.708786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:07.004640 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:07.019391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b1218325-b07d-4da7-9a1a-b4e04ab20dee tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.369032 Oct 10 12:10:07.020957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 161/294] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:06 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:07.606532 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:07.608037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:07.618866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:07.620537 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:07.621163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:07.622142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:07.623046 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:07.623643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:07.645921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:07.732732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:07.743111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-18b7aa70-b9d4-4530-b893-1a0a3718f51d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1271 microversion: 2.1 time: 0.144751 Oct 10 12:10:07.745054 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 134/295] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:07 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:08.070491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:08.073727 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:08.085768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=4 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:08.089944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:08.091538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:08.093604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:08.098650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:08.100364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:08.102054 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:08.420729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:08.431646 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8b96464f-50ba-4b6c-91e6-2a39ad0dc850 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.369747 Oct 10 12:10:08.433022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 162/296] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:08 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:08.793766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:08.798035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:08.826842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:08.842984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:08.843670 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:08.844127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:08.844897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:08.845418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:08.846041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:09.025322 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:09.035376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-99a01889-3f7c-42ec-b7dd-32a987062c32 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1271 microversion: 2.1 time: 0.250408 Oct 10 12:10:09.050466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 135/297] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:08 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:09.475374 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:09.476953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:09.492968 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:09.493473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:09.493923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:09.495170 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:09.495318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:09.495705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:09.537713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-7f8c4fd9-10bd-4b2c-a617-c0f65e61060c req-6ff31df9-8f15-44f7-b098-eb0904fd7413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f411d6a5-3966-4066-83a4-5499708446b4", "name": "network-vif-plugged", "status": "completed", "tag": "5a6667d5-f54b-479b-8dc6-7057368e05a2"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:09.557698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7f8c4fd9-10bd-4b2c-a617-c0f65e61060c req-6ff31df9-8f15-44f7-b098-eb0904fd7413 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:09.558071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7f8c4fd9-10bd-4b2c-a617-c0f65e61060c req-6ff31df9-8f15-44f7-b098-eb0904fd7413 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:09.561438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7f8c4fd9-10bd-4b2c-a617-c0f65e61060c req-6ff31df9-8f15-44f7-b098-eb0904fd7413 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:09.580267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-7f8c4fd9-10bd-4b2c-a617-c0f65e61060c req-6ff31df9-8f15-44f7-b098-eb0904fd7413 service nova] Creating event network-vif-plugged:5a6667d5-f54b-479b-8dc6-7057368e05a2 for instance f411d6a5-3966-4066-83a4-5499708446b4 on hv-cinder-86020 Oct 10 12:10:09.587224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-7f8c4fd9-10bd-4b2c-a617-c0f65e61060c req-6ff31df9-8f15-44f7-b098-eb0904fd7413 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054711 Oct 10 12:10:09.591685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 136/298] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:09.868231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:09.901221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-49130493-2570-43c3-968e-dc90b5cde204 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.427698 Oct 10 12:10:09.905555 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 163/299] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:09 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:10.062042 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:10.063684 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:10.079006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:10.084613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:10.084613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:10.085946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:10.087775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:10.089101 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:10.744945 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:10.768863 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-06287f89-581b-4839-9307-3f677c2bcd2a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.711126 Oct 10 12:10:10.782772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 137/300] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:10 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:10.958487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:10.960325 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:10.969605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:10.970926 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:10.971577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:10.972483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:10.973101 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:10.974576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:11.027366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-297590915", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67af5388-ef78-467a-b602-e98d5343259e"}], "security_groups": [{"name": "tempest-securitygroup--377936011"}], "key_name": "tempest-keypair-839708287", "user_data": "}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:11.237609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] validate_networks() for [('67af5388-ef78-467a-b602-e98d5343259e', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:10:11.442172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:11.493055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bc8c4fe0-6ed2-43ff-8524-8f73fc352ba8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1319 microversion: 2.1 time: 0.546272 Oct 10 12:10:11.517811 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 164/301] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:10 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:11.543285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-18de8889-a780-4415-94b8-b831fd26737a req-a7d2490a-779b-4fdb-a493-6972bcfaa293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25130957-18b2-48c6-b18f-6d2b52970403", "tag": "1429178b-a618-476c-afc7-79cda9882c22"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:11.564385 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18de8889-a780-4415-94b8-b831fd26737a req-a7d2490a-779b-4fdb-a493-6972bcfaa293 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:11.566047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18de8889-a780-4415-94b8-b831fd26737a req-a7d2490a-779b-4fdb-a493-6972bcfaa293 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:11.567756 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18de8889-a780-4415-94b8-b831fd26737a req-a7d2490a-779b-4fdb-a493-6972bcfaa293 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:11.599141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-18de8889-a780-4415-94b8-b831fd26737a req-a7d2490a-779b-4fdb-a493-6972bcfaa293 service nova] Creating event network-changed:1429178b-a618-476c-afc7-79cda9882c22 for instance 25130957-18b2-48c6-b18f-6d2b52970403 on hv-cinder-86020 Oct 10 12:10:11.610193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-18de8889-a780-4415-94b8-b831fd26737a req-a7d2490a-779b-4fdb-a493-6972bcfaa293 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075825 Oct 10 12:10:11.613381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 165/302] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:10:11.810440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:11.811602 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:11.821445 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:11.822347 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:11.823457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:11.824506 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:11.825197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:11.825743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:12.339315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:12.355819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9c20c24f-3666-41e7-967a-96a393af2ca7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.549534 Oct 10 12:10:12.356920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 166/303] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:11 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:12.386603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:10:12.390577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:10:12.392153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:10:12.393942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:10:12.394909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:10:12.414436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:12.415796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:12.416842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:12.418566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:12.423943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:12.423943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:12.468435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for project 782c5fd84235487caac5f9a7e18563cb. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:10:12.480587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Getting quotas for user 45c87aa85b7d45fe8acf6f36a3d2a639 and project 782c5fd84235487caac5f9a7e18563cb. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:10:12.503433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:10:12.507363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:10:12.548025 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:12.550167 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:12.574542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:12.574542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:12.574542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:12.574542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:12.575538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:12.575538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:12.764448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-93ca4fe4-2aac-4783-8253-583df2b30825 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.736213 Oct 10 12:10:12.766428 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 138/304] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:10:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:10:12.805085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2fae80ff-934d-4aca-a5ad-b73ee57f1298 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:12.808204 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2fae80ff-934d-4aca-a5ad-b73ee57f1298 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:13.045508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2fae80ff-934d-4aca-a5ad-b73ee57f1298 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:13.072349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2fae80ff-934d-4aca-a5ad-b73ee57f1298 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1244 microversion: 2.1 time: 0.291168 Oct 10 12:10:13.078222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 139/305] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:12 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1244 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:13.314297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:13.327890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-00a4c8d9-e723-419a-a792-aa3593a0b80b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1508 microversion: 2.1 time: 0.789320 Oct 10 12:10:13.328916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 167/306] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:12 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1508 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:13.413117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:13.423160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:13.456191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:13.457012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:13.475726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:13.483091 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:13.485618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:13.486077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:13.934074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:13.950985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3daa8646-f32f-4c2e-9a69-286da0b4b82e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.548725 Oct 10 12:10:13.951780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 140/307] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:13 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:14.123199 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:14.125703 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:14.146973 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:14.147645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:14.148117 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:14.148849 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:14.149307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:14.149768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:14.269343 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:14.279957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-196eed10-803d-4757-8249-07d451a5497a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1248 microversion: 2.1 time: 0.164367 Oct 10 12:10:14.284099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 168/308] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:14 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1248 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:14.993769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:14.994394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:15.001590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:15.002121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:15.002570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:15.004555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:15.004555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:15.004555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:15.182869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:15.194347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-aab821e1-010f-474c-90ea-4c348c2fa8da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.204815 Oct 10 12:10:15.214716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 141/309] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:14 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:15.338762 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:15.338762 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:15.338762 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:15.354910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:15.356219 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:15.358653 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:15.359944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:15.362024 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:15.362482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:15.499398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:15.514005 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fb8afd4d-98cf-47db-b9bd-ccdd05966d86 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1248 microversion: 2.1 time: 0.187265 Oct 10 12:10:15.514997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 169/310] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:15 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1248 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:16.240776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:16.241455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:16.259110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:16.260203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:16.262389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:16.263209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:16.264542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:16.264995 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:16.565910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:16.569196 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:16.577541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=22 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:16.591134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:16.593675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:16.594454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:16.596049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:16.597554 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:16.598437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:16.661177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:16.661177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2be0dd9e-0743-4c7e-8c28-0639e077bac8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.423453 Oct 10 12:10:16.663319 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 142/311] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:16 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:16.762559 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:16.773218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-989caf6f-dcf2-445f-9f2e-8e96fe8df39e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1248 microversion: 2.1 time: 0.221585 Oct 10 12:10:16.773820 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 170/312] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:16 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1248 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:17.713839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:17.717430 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:17.733322 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:17.733834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:17.734656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:17.736069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:17.737389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:17.738219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:17.825975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:17.827492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:17.838618 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:17.839910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:17.840531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:17.841446 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:17.842271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:17.843081 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:18.016624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:18.034125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6a593d73-6b9c-4cd7-9e43-e2bbd1b9d19a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1240 microversion: 2.1 time: 0.225113 Oct 10 12:10:18.055479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 171/313] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:17 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1240 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:18.161521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:18.178515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ecfa0beb-174b-47ed-a2ff-154648d1b4c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.470603 Oct 10 12:10:18.182866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 143/314] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:17 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:19.066472 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:19.068867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:19.085798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:19.086597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:19.087083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:19.087838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:19.088405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:19.091279 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:19.208065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:19.209187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:19.220468 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:19.233790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f586545a-395e-4f42-8c11-80feaa46e0a6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1296 microversion: 2.1 time: 0.174495 Oct 10 12:10:19.243417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:19.248045 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:19.248968 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:19.253092 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:19.253854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:19.254607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:19.267121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 172/315] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:19 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1296 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:19.505614 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:19.517044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b7004aef-62c8-4bb2-8af9-bf64fe89c4e2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.317208 Oct 10 12:10:19.518307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 144/316] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:19 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:20.274456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:20.279053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:20.297462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:20.299408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:20.301234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:20.303126 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:20.304706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:20.318177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:20.512551 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:20.525868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a5d0785d-427e-403b-b1d4-e9012c3d9a54 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1302 microversion: 2.1 time: 0.263419 Oct 10 12:10:20.527048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 173/317] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:20 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1302 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:20.556339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:20.560453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:20.605179 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:20.608763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:20.612396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:20.614132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:20.619675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:20.621146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:20.813493 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-767e9dc4-85bf-422c-92a6-7d44386f42c2 req-ce1534a5-9e29-4d30-89d3-5325a8d12899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25130957-18b2-48c6-b18f-6d2b52970403", "name": "network-vif-plugged", "status": "completed", "tag": "1429178b-a618-476c-afc7-79cda9882c22"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:20.841139 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-767e9dc4-85bf-422c-92a6-7d44386f42c2 req-ce1534a5-9e29-4d30-89d3-5325a8d12899 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:20.841738 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-767e9dc4-85bf-422c-92a6-7d44386f42c2 req-ce1534a5-9e29-4d30-89d3-5325a8d12899 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:20.842198 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-767e9dc4-85bf-422c-92a6-7d44386f42c2 req-ce1534a5-9e29-4d30-89d3-5325a8d12899 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:20.852114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:20.871125 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-767e9dc4-85bf-422c-92a6-7d44386f42c2 req-ce1534a5-9e29-4d30-89d3-5325a8d12899 service nova] Creating event network-vif-plugged:1429178b-a618-476c-afc7-79cda9882c22 for instance 25130957-18b2-48c6-b18f-6d2b52970403 on hv-cinder-86020 Oct 10 12:10:20.878536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-767e9dc4-85bf-422c-92a6-7d44386f42c2 req-ce1534a5-9e29-4d30-89d3-5325a8d12899 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078608 Oct 10 12:10:20.879924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 174/318] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:10:20.917569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:20.932266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fd2facb2-6910-4062-aeed-21a62ea86f96 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.386737 Oct 10 12:10:20.947677 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 145/319] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:20 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:21.578548 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:21.581185 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:21.592326 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:21.593454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:21.594427 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:21.596441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:21.596441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:21.597038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:21.884897 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:21.897654 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-442aca47-58c9-4fd8-b53f-02050d4eb48a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.334497 Oct 10 12:10:21.908686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 175/320] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:21 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:21.981492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:21.982550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:21.989777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:22.009527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:22.010412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:22.017339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:22.022258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:22.023179 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:22.023948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:22.329069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:22.342161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f2c13d67-1c46-4cb7-ae14-8d57ae6b9e0b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.369824 Oct 10 12:10:22.343448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 146/321] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:21 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:22.927097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:22.929260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:22.942737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:22.944245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:22.945743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:22.947529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:22.948876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:22.950015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:23.226582 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:23.243234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7285f36f-942f-48f1-815c-6c3b7dd09234 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.324794 Oct 10 12:10:23.248568 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 176/322] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:22 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:23.371568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:23.373707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:23.379758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:23.381491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=8 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:23.394701 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:23.396530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:23.397802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:23.399481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:23.403181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:23.404567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:23.724819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:23.740971 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3c1ab8df-e747-4d70-87ca-a0e62cd8020f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.377295 Oct 10 12:10:23.751071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 147/323] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:23 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:24.289538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:24.290850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:24.308376 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:24.309563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:24.310349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:24.311959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:24.313809 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:24.314624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:24.576789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:24.594424 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d6ee7dd8-c5f2-43b6-9ce4-15c3899175b3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.314173 Oct 10 12:10:24.617204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 177/324] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:24 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:24.769853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:24.773930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:24.788761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:24.789596 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:24.790268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:24.792318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:24.793451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:24.794247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:24.847818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-9c61b642-f95e-4f10-967b-b60e01da9a6a req-1a4b225c-8cb8-4087-b400-6d9cf96e39aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0f9c51-ab73-4450-8f3e-eb5d492a34d0", "tag": "5d658caa-5deb-4849-8248-3505cf81be8d"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:24.868123 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9c61b642-f95e-4f10-967b-b60e01da9a6a req-1a4b225c-8cb8-4087-b400-6d9cf96e39aa service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:24.868641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9c61b642-f95e-4f10-967b-b60e01da9a6a req-1a4b225c-8cb8-4087-b400-6d9cf96e39aa service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:24.869153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9c61b642-f95e-4f10-967b-b60e01da9a6a req-1a4b225c-8cb8-4087-b400-6d9cf96e39aa service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:24.883063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-9c61b642-f95e-4f10-967b-b60e01da9a6a req-1a4b225c-8cb8-4087-b400-6d9cf96e39aa service nova] Creating event network-changed:5d658caa-5deb-4849-8248-3505cf81be8d for instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 on hv-cinder-86020 Oct 10 12:10:24.913888 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-9c61b642-f95e-4f10-967b-b60e01da9a6a req-1a4b225c-8cb8-4087-b400-6d9cf96e39aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070955 Oct 10 12:10:24.913888 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 178/325] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:25.123834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:25.152795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-087bf7b4-5afb-4121-a4e5-cc87fa54db95 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1313 microversion: 2.1 time: 0.390434 Oct 10 12:10:25.153545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 148/326] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:24 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:25.641022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:25.644856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:25.665684 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:25.666347 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:25.667076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:25.668162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:25.668783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:25.669314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:26.038616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:26.051283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-624e93d9-2364-4756-85f6-4c2e5c9f5b7a tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.418703 Oct 10 12:10:26.052244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 179/327] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:25 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:26.201973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:26.205523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:26.220860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:26.223199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:26.223968 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:26.225762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:26.226897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:26.227686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:26.549557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:26.575234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8953d90a-c600-4a83-917a-e643072c1846 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1497 microversion: 2.1 time: 0.381859 Oct 10 12:10:26.591517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 149/328] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:26 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1497 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:27.083444 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:27.084559 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:27.096453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:27.097253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:27.098038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:27.100009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:27.101170 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:27.101957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:27.346558 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:27.369249 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0b9a4404-c8e6-49e2-9ab3-f652548e6368 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.285561 Oct 10 12:10:27.369249 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 180/329] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:27 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:28.172765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-db1b2eb6-44ff-47b7-80b0-0d40c3ee919a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Action: 'create', calling method: .version_select at 0x7f6d12d20700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1382985420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK59H0G5IYES+9rMSuKp1KjTzC1qO30rymJ4/kfh2zb2PsvA7wq/VF+HRi86qC7AGvZAeMXJoGJASt2pEjMOOiHWsv8SMy/QdjFwuWsxgIRZ0GiGSJSDeN7TESkr1ipI8A=="}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:28.202636 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-db1b2eb6-44ff-47b7-80b0-0d40c3ee919a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Getting quotas for project 26773079b6914a20ab27109b0dec496a. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:10:28.213508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-db1b2eb6-44ff-47b7-80b0-0d40c3ee919a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Getting quotas for user 21c537b0fefe4fb1b51483ac0e3cf2d1 and project 26773079b6914a20ab27109b0dec496a. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:10:28.319464 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:28.320253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:28.326857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:28.327348 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:28.328049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:28.328948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:28.329575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:28.330695 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:28.361844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Going to try to terminate instance {{(pid=121298) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:10:28.366988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-db1b2eb6-44ff-47b7-80b0-0d40c3ee919a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.478228 Oct 10 12:10:28.376615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 150/330] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:10:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:28.400900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:28.401582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:28.414539 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:28.415267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:28.415789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:28.416529 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:28.417213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:28.418232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:28.767407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3a5b4ce6-63b3-4a39-81b4-487d5d5ae8c7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 204 len: 0 microversion: 2.1 time: 0.451621 Oct 10 12:10:28.768016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 181/331] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:10:28 2022] DELETE /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:10:28.776787 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:28.789572 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:28.799653 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:28.808111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e3924965-1e56-49af-a68e-a68a6c205e51 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.412410 Oct 10 12:10:28.815767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 151/332] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:28 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:28.817576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:28.825090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:28.825870 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:28.827282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:28.828632 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:28.829962 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:29.079048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:29.097154 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-efba6a3f-277f-4ef7-98f0-d67048ba278c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1503 microversion: 2.1 time: 0.316720 Oct 10 12:10:29.102749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 182/333] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:28 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:29.839467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:29.840864 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:29.851274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:29.851906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:29.852357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:29.853087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:29.853548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:29.854167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:30.097705 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:30.116523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2d013579-85e2-4697-8bb4-5be4df80f07f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.284991 Oct 10 12:10:30.137146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 152/334] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:29 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:30.146779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:30.148097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:30.156836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:30.158211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:30.158853 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:30.159989 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:30.160446 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:30.161048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:30.491127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:30.512160 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f7951994-2046-4451-97ae-2a0adaca86e4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1503 microversion: 2.1 time: 0.373120 Oct 10 12:10:30.514183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 183/335] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:30 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1503 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:31.144767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:31.146542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:31.157301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:31.157990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:31.162521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:31.162521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:31.162521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:31.162521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:31.374363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:31.391788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dd7e4bef-32e7-4d1a-b0b3-2d39d7b8f49b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.253870 Oct 10 12:10:31.394205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 153/336] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:31 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:31.552940 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:31.554652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:31.569042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:31.570413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:31.571320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:31.572408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:31.573123 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:31.573764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:31.804282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:31.826417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b9beb1e7-f7c2-4516-a73b-f7598678b9de tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1503 microversion: 2.1 time: 0.273763 Oct 10 12:10:31.827477 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 184/337] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:31 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:32.417143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:32.419230 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:32.427654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:32.428520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:32.429188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:32.430139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:32.430858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:32.431493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:32.449922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:32.749738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:32.770010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-677741db-333d-416f-9208-989f403ca689 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.356334 Oct 10 12:10:32.771189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 154/338] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:32 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:32.868999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:32.870443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:32.877940 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:32.878774 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:32.879485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:32.881683 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:32.882684 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:32.884915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:33.082950 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:33.099479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9e56f9b9-d5a5-40e8-9e5a-7d4e8bcc5b4b tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1503 microversion: 2.1 time: 0.234504 Oct 10 12:10:33.113918 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 185/339] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:32 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:33.827450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:33.828185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:33.841975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:33.843193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:33.844450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:33.848927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:33.849864 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:33.850951 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:34.059659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:34.071073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fc1c44c8-696b-4ff1-8fdc-1e5868b37bf8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.260287 Oct 10 12:10:34.072114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 155/340] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:33 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:34.139371 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:34.141006 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:34.150121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:34.150924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:34.151604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:34.152605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:34.153481 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:34.154197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:34.361658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:34.372670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-85fbaeea-1eb9-4cf9-935a-99765da98346 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1503 microversion: 2.1 time: 0.239650 Oct 10 12:10:34.384563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 186/341] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:34 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:35.083463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-d23159b0-9f30-4264-86a3-a024059228a4 req-7a2fe63d-82dd-4a13-8073-82dc01391c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25130957-18b2-48c6-b18f-6d2b52970403", "name": "network-vif-deleted", "tag": "1429178b-a618-476c-afc7-79cda9882c22"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:35.094690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d23159b0-9f30-4264-86a3-a024059228a4 req-7a2fe63d-82dd-4a13-8073-82dc01391c57 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:35.095613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d23159b0-9f30-4264-86a3-a024059228a4 req-7a2fe63d-82dd-4a13-8073-82dc01391c57 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:35.096050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d23159b0-9f30-4264-86a3-a024059228a4 req-7a2fe63d-82dd-4a13-8073-82dc01391c57 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:35.107281 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:35.108445 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:35.111110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-d23159b0-9f30-4264-86a3-a024059228a4 req-7a2fe63d-82dd-4a13-8073-82dc01391c57 service nova] Creating event network-vif-deleted:1429178b-a618-476c-afc7-79cda9882c22 for instance 25130957-18b2-48c6-b18f-6d2b52970403 on hv-cinder-86020 Oct 10 12:10:35.118026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-d23159b0-9f30-4264-86a3-a024059228a4 req-7a2fe63d-82dd-4a13-8073-82dc01391c57 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037805 Oct 10 12:10:35.121615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 156/342] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:35.125798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:35.127326 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:35.128061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:35.129234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:35.130245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:35.131044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:35.317776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:35.326800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-144e2376-411b-431a-8250-9e6ba6eda83c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.223532 Oct 10 12:10:35.327451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 187/343] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:35 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:35.404875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:35.413526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:35.417805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:35.418639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:35.419496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:35.420757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:35.421603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:35.422355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:35.524371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:35.537295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-51dca277-eccb-4e37-9fd1-61062f82ceaf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1298 microversion: 2.1 time: 0.141181 Oct 10 12:10:35.538358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 157/344] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:35 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:36.365298 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:36.365929 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:36.372485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:36.372973 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:36.373413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:36.374124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:36.374577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:36.375038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:36.578924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:36.583606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:36.584048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:36.599977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fc623880-8dbd-4eaa-a86d-69a15e37e1cc tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.238913 Oct 10 12:10:36.601616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:36.602877 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:36.603078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 188/345] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:36 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:36.604172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:36.605484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:36.606455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:36.610116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:36.678425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:36.679593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:36.680456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:36.681364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lazy-loading 'fault' on Instance uuid 25130957-18b2-48c6-b18f-6d2b52970403 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:10:36.752725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:36.769869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ab1ec8a0-2429-47ee-a14a-46f7f74b026a tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 200 len: 1303 microversion: 2.1 time: 0.204450 Oct 10 12:10:36.770513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 158/346] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:36 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:36.874453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-e1876c50-903c-4474-8031-958ffd024d12 req-3c17bf89-dcec-4c8f-af56-039b7f212a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0f9c51-ab73-4450-8f3e-eb5d492a34d0", "name": "network-vif-plugged", "status": "completed", "tag": "5d658caa-5deb-4849-8248-3505cf81be8d"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:36.903080 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-e1876c50-903c-4474-8031-958ffd024d12 req-3c17bf89-dcec-4c8f-af56-039b7f212a41 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:36.904058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-e1876c50-903c-4474-8031-958ffd024d12 req-3c17bf89-dcec-4c8f-af56-039b7f212a41 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:36.904853 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-e1876c50-903c-4474-8031-958ffd024d12 req-3c17bf89-dcec-4c8f-af56-039b7f212a41 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:36.922693 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-e1876c50-903c-4474-8031-958ffd024d12 req-3c17bf89-dcec-4c8f-af56-039b7f212a41 service nova] Creating event network-vif-plugged:5d658caa-5deb-4849-8248-3505cf81be8d for instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 on hv-cinder-86020 Oct 10 12:10:36.928949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-e1876c50-903c-4474-8031-958ffd024d12 req-3c17bf89-dcec-4c8f-af56-039b7f212a41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064003 Oct 10 12:10:36.929571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 189/347] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:10:37.640528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:37.641219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:37.648737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:37.649247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:37.649679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:37.650388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:37.650880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:37.651310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:37.807751 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:37.808710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:37.809232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 25130957-18b2-48c6-b18f-6d2b52970403] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:37.818234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5481a4c1-9ef0-4ecd-b3e0-6e26b6a8653f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.181564 Oct 10 12:10:37.818885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 159/348] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:37 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:37.823204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:37.824301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:37.825299 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:37.826822 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:37.827697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:37.828525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:37.855121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] HTTP exception thrown: Instance 25130957-18b2-48c6-b18f-6d2b52970403 could not be found. Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Request method failure captured: Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 HTTP/1.1 Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAuR08e8sTG2wW0ob893Z4yFLoePyJfLwtfzHRl1NegSjdUHNHoIwucz7h-qZkTG1cp2pp_0YDEOg6zmSDIhxPs0Sa5iAp9sHtnBcfa64gMBx6NsNVg_W3dNFCKposssGuBStUUuMJmeYnnqkwtjqC7g-qKnYfvdt5jBlHIXgy4dYNA Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: 4326aa9c66954652943d3754b121bce8 Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-VolumesActionsTest-1379031834 Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:10:37.856995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4326aa9c66954652943d3754b121bce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4326aa9c66954652943d3754b121bce8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4326aa9c66954652943d3754b121bce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4326aa9c66954652943d3754b121bce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-VolumesActionsTest-1379031834 Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: 4326aa9c66954652943d3754b121bce8 Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-VolumesActionsTest-1379031834 Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-VolumesActionsTest-1379031834-project Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: d58683f7689a4356badd8f4bb30850a5 Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-VolumesActionsTest-1379031834-project Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance 25130957-18b2-48c6-b18f-6d2b52970403 could not be found. Oct 10 12:10:37.864541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': '25130957-18b2-48c6-b18f-6d2b52970403'} Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25130957-18b2-48c6-b18f-6d2b52970403 could not be found. Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:10:37.865994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25130957-18b2-48c6-b18f-6d2b52970403 could not be found. Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25130957-18b2-48c6-b18f-6d2b52970403 could not be found. Oct 10 12:10:37.868342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:10:37.870407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Returning 404 to user: Instance 25130957-18b2-48c6-b18f-6d2b52970403 could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:10:37.870407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f718608d-fbcd-446c-8a41-61b85e4daad8 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403" status: 404 len: 111 microversion: 2.1 time: 0.058239 Oct 10 12:10:37.870407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 190/349] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:37 2022] GET /compute/v2.1/servers/25130957-18b2-48c6-b18f-6d2b52970403 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:10:38.037586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-977530239", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "networks": [{"uuid": "435564f3-e5dd-46a9-88d6-ee2f75cdcd4e"}]}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:38.228409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=4 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:38.857701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:38.858333 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:38.864912 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:38.865405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:38.865839 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:38.866580 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:38.867073 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:38.867500 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:39.056004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:39.060208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:39.065710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7c1be9b6-9335-472c-ac7b-602902514138 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.211903 Oct 10 12:10:39.066307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 191/350] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:38 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:40.099901 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:40.101503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:40.113482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:40.114107 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:40.114647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:40.115591 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:40.116215 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:40.116744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:40.364945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:40.373283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4610e093-d3cb-4032-aad6-5eb064ecfe45 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1369 microversion: 2.1 time: 0.281177 Oct 10 12:10:40.373893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 192/351] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:40 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:41.410083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:41.410830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:41.417403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:41.417891 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:41.418357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:41.419112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:41.419564 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:41.419994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:41.580001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:41.588369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c7117b00-354e-4ebe-a01d-1f5a98963b6d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1563 microversion: 2.1 time: 0.182258 Oct 10 12:10:41.588975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 193/352] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:41 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:41.623856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:41.624357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:41.632007 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:41.637641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:41.637641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:41.637641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:41.637641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:41.638330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:41.727560 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cb7869ec-774a-41ed-931f-28849b88a8f1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107812 Oct 10 12:10:41.728323 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 194/353] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:10:41 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:42.488026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d8bb2ce-b0c8-4b4a-b395-cb063c7596d8", "device": "/dev/sdb"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:42.488026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:42.488026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:42.488026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:42.491779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:42.491779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:42.491779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:42.491779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:43.469324 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-da6f08c7-6deb-414f-80bc-88872ccd401b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "POST /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012897 Oct 10 12:10:43.470888 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 195/354] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:10:42 2022] POST /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4/os-volume_attachments => generated 194 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:10:43.477314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-40f05957-e4dc-49fe-b36a-815780f121fb req-1bcf4b29-0b5f-46d6-b660-66ec60c7b2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0f9c51-ab73-4450-8f3e-eb5d492a34d0", "tag": "5d658caa-5deb-4849-8248-3505cf81be8d"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:10:43.488870 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-40f05957-e4dc-49fe-b36a-815780f121fb req-1bcf4b29-0b5f-46d6-b660-66ec60c7b2fd service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:43.490052 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-40f05957-e4dc-49fe-b36a-815780f121fb req-1bcf4b29-0b5f-46d6-b660-66ec60c7b2fd service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:43.491482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-40f05957-e4dc-49fe-b36a-815780f121fb req-1bcf4b29-0b5f-46d6-b660-66ec60c7b2fd service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:43.504807 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-40f05957-e4dc-49fe-b36a-815780f121fb req-1bcf4b29-0b5f-46d6-b660-66ec60c7b2fd service nova] Creating event network-changed:5d658caa-5deb-4849-8248-3505cf81be8d for instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 on hv-cinder-86020 Oct 10 12:10:43.511803 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-40f05957-e4dc-49fe-b36a-815780f121fb req-1bcf4b29-0b5f-46d6-b660-66ec60c7b2fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039236 Oct 10 12:10:43.512833 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 196/355] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:10:47.814133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=31 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:48.050321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:50.876829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] validate_networks() for [('435564f3-e5dd-46a9-88d6-ee2f75cdcd4e', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:10:51.344259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:10:51.345245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:10:51.345728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:10:51.346141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:10:51.346606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:10:51.357384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:51.357893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:51.358337 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:51.359143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:51.359608 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:51.360141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:51.379911 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Getting quotas for project 4326aa9c66954652943d3754b121bce8. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:10:51.385406 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Getting quotas for user d58683f7689a4356badd8f4bb30850a5 and project 4326aa9c66954652943d3754b121bce8. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:10:51.399349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:10:51.402159 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:10:51.534905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0733f249-124b-4dd4-b138-561d10b62642 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.502160 Oct 10 12:10:51.535489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 160/356] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 13504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:10:51.557372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-40dae828-3cdf-413a-a6f3-4290a77bbda6 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:51.558078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-40dae828-3cdf-413a-a6f3-4290a77bbda6 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:51.561496 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:51.668187 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-40dae828-3cdf-413a-a6f3-4290a77bbda6 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:51.687171 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-40dae828-3cdf-413a-a6f3-4290a77bbda6 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1213 microversion: 2.1 time: 0.141222 Oct 10 12:10:51.689035 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 197/357] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:51 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:52.728072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:52.729214 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:52.742082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:52.742082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:52.742082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:52.742789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:52.743269 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:52.743815 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:52.817375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:52.833797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2467c062-3871-417c-9593-3891dda383ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1217 microversion: 2.1 time: 0.112792 Oct 10 12:10:52.834834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 161/358] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:52 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:53.869957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:53.870709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:53.874271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:53.879671 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:53.880164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:53.880604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:53.881359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:53.881834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:53.882261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:53.963524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:53.977266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ec9f2ac2-58eb-4c40-b92d-ba1572f1de68 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1265 microversion: 2.1 time: 0.111407 Oct 10 12:10:53.978407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 198/359] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:53 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:55.015136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:55.028275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:55.028275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:55.028275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:55.028275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:55.028763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:55.028763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:55.028763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:55.093973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:55.103192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3528d268-1320-491b-9c17-5ce537c479a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1273 microversion: 2.1 time: 0.092451 Oct 10 12:10:55.103786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 162/360] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:55 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:56.127416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:56.128042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:56.135377 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:56.135867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:56.136304 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:56.137027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:56.137482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:56.137908 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:56.216395 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:56.226871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c395e8dc-7bc4-4e17-aaf1-4fd7e7e009ac tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1273 microversion: 2.1 time: 0.103668 Oct 10 12:10:56.227572 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 199/361] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:56 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:57.251627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:57.252243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:57.259425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:57.259924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:57.260367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:57.261135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:57.261593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:57.262063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:57.336425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:57.347370 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-97eb93ed-d490-48ac-a3c1-3687b83b24bd tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1273 microversion: 2.1 time: 0.100178 Oct 10 12:10:57.347961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 163/362] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:57 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:10:57.897063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:57.897665 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:57.904130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:57.904613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:57.905058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:57.905751 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:57.906211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:57.907136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:57.932197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5d983990-8a1f-4d36-98e2-aeebab3e9236 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/ips" status: 200 len: 143 microversion: 2.1 time: 0.038970 Oct 10 12:10:57.932802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 200/363] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:10:57 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/ips => generated 143 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:10:58.375814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:58.376823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:58.387531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:58.388430 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:58.389156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:58.390338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:58.391645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:58.392381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:58.478448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:58.486214 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f748445f-fb9f-4bde-8a67-fe0e2d4780be tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1273 microversion: 2.1 time: 0.117773 Oct 10 12:10:58.486826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 164/364] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:58 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:10:59.508333 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:10:59.508948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:10:59.516173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:59.516643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:59.517086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:59.517847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:10:59.518299 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:10:59.518765 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:10:59.586689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:10:59.592407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4156ab53-6f76-49dc-a855-8089f23bbfb3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1273 microversion: 2.1 time: 0.087940 Oct 10 12:10:59.593003 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 201/365] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:10:59 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:00.616782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:00.617379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:00.624090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:00.624582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:00.625018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:00.626279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:00.626762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:00.627192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:00.703309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:00.711878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b80a44e8-e0bb-42bd-8e66-9bd7c18ea5c9 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1273 microversion: 2.1 time: 0.098899 Oct 10 12:11:00.712321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 165/366] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:00 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:01.361442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:01.362045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:01.368570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:01.369060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:01.369510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:01.370224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:01.370701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:01.371131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:01.396417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a1253608-db2a-48a3-bd4c-ce96c177e35e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/ips" status: 200 len: 150 microversion: 2.1 time: 0.039018 Oct 10 12:11:01.397009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 202/367] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:11:01 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:11:01.737812 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:01.739667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:01.742869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:01.744147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=6 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:01.752923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:01.753694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:01.754174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:01.754930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:01.755403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:01.755837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:01.826567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:01.835725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fe30a6bf-2217-4634-83f4-7a0e3f569b56 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1273 microversion: 2.1 time: 0.103768 Oct 10 12:11:01.843668 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 166/368] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:01 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:02.859054 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:02.859844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:02.861643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:02.867579 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:02.868082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:02.868520 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:02.869238 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:02.869692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:02.870124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:02.939180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:02.948027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ab068084-602c-4ead-a3cd-d3019afc34c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1283 microversion: 2.1 time: 0.093020 Oct 10 12:11:02.948737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 203/369] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:02 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1283 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:03.973987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:03.975302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:03.984851 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:03.985671 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:03.986265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:03.987197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:03.987765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:03.988325 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:04.085079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:04.097957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-035646cd-3050-4b84-a464-dd20788cb178 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1271 microversion: 2.1 time: 0.129205 Oct 10 12:11:04.099170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 167/370] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:03 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:05.126562 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:05.127222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:05.134169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:05.134754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:05.135204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:05.136027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:05.136647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:05.137082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:05.311402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:05.323778 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cf02ac8c-6e61-40e6-825b-939e2532656d tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.202973 Oct 10 12:11:05.339077 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 204/371] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:05 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:05.928424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-abaae0f8-67bf-42f0-8b86-edae1971602a req-50cbae27-6d75-42b5-ae07-432ae20d69e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60af3e29-5610-4ff4-8d88-89a3db8b6c9b", "tag": "56440d57-210b-4ebf-abeb-b3fd4d1b4d5a"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:05.939291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-abaae0f8-67bf-42f0-8b86-edae1971602a req-50cbae27-6d75-42b5-ae07-432ae20d69e4 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:05.939785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-abaae0f8-67bf-42f0-8b86-edae1971602a req-50cbae27-6d75-42b5-ae07-432ae20d69e4 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:05.940324 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-abaae0f8-67bf-42f0-8b86-edae1971602a req-50cbae27-6d75-42b5-ae07-432ae20d69e4 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:05.952944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-abaae0f8-67bf-42f0-8b86-edae1971602a req-50cbae27-6d75-42b5-ae07-432ae20d69e4 service nova] Creating event network-changed:56440d57-210b-4ebf-abeb-b3fd4d1b4d5a for instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b on hv-cinder-86020 Oct 10 12:11:05.959133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-abaae0f8-67bf-42f0-8b86-edae1971602a req-50cbae27-6d75-42b5-ae07-432ae20d69e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034215 Oct 10 12:11:05.959772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 168/372] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:11:06.350980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:06.351850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:06.358752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:06.359249 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:06.359698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:06.360418 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:06.360889 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:06.361328 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:06.534949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:06.548336 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8c0e0a57-5ea1-4f0a-8f26-21f0ae5c16a3 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.200745 Oct 10 12:11:06.549223 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 205/373] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:06 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:07.208486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7999157-a978-46b4-b273-468d69c5c54e"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:07.212197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:07.219558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:07.220042 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:07.220652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:07.221518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:07.222457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:07.223128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:07.575747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:07.576464 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:07.583709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:07.584204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:07.584647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:07.585394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:07.585858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:07.586289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:07.736964 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:07.745013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-711264da-f73d-495e-9a65-051e7a0e0edf tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.173492 Oct 10 12:11:07.745602 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 206/374] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:07 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:08.769163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:08.769882 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:08.776564 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:08.777048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:08.777489 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:08.778189 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:08.778638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:08.779086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:08.949160 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:08.957674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-30d9bd4b-95df-4ed5-ae4b-53c2f2ce7286 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.192551 Oct 10 12:11:08.958270 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 207/375] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:08 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:09.981138 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:09.981900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:09.988237 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:09.988723 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:09.989163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:09.989857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:09.990314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:09.990775 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:10.135703 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:10.144958 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d96d542e-5f34-4d19-9b5d-8613cfb3de7e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.167555 Oct 10 12:11:10.145545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 208/376] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:09 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:11.167893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:11.168675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:11.175626 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:11.176172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:11.176663 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:11.177417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:11.177908 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:11.178401 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:11.317818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:11.325600 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ce6040ae-920f-47d8-88d6-cc526aa19910 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.161600 Oct 10 12:11:11.326168 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 209/377] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:11 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:12.350043 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:12.350898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:12.357398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:12.357911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:12.358345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:12.359098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:12.360096 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:12.360521 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:12.518647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:12.527008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-60234a04-bc0d-477d-9c48-bad5b0241d07 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.180993 Oct 10 12:11:12.527569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 210/378] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:12 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:13.549770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:13.550415 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:13.556687 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:13.557186 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:13.557642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:13.563340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:13.563340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:13.563340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:13.722627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:13.731501 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-daf96c16-d13f-415b-8c35-3fce22344958 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.185969 Oct 10 12:11:13.732095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 211/379] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:13 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:14.756030 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:14.756921 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:14.763836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:14.764502 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:14.765015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:14.765780 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:14.766397 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:14.766915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:14.908481 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:14.917334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d2f0cdb9-0034-4772-9bc8-f67b008ef41f tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.165324 Oct 10 12:11:14.918192 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 212/380] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:14 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:15.942290 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:15.943020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:15.950337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:15.950869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:15.951310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:15.952145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:15.952631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:15.953062 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:16.084592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:16.092289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6984c682-6255-4a93-849c-9dc1519ecd0c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.154504 Oct 10 12:11:16.092851 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 213/381] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:15 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:17.115019 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:17.120378 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:17.121955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:17.122454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:17.122929 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:17.123618 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:17.124067 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:17.124488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:17.217849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:17.258140 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:17.266471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2af3c3b8-0a59-4cfc-9787-025599b91385 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.154732 Oct 10 12:11:17.267235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 214/382] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:17 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:17.302519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=52 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:18.245347 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:18.245950 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:18.252442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:18.252442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:18.252442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:18.252442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:18.257411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:18.257411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:18.258917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:18.281276 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b4977201-462c-4211-906c-5ccca308696e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/ips" status: 200 len: 152 microversion: 2.20 time: 0.039937 Oct 10 12:11:18.282651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 215/383] 10.222.0.46 () {60 vars in 1289 bytes} [Mon Oct 10 12:11:18 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:11:18.289750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:18.290370 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:18.296757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:18.297816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:18.298376 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:18.299059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:18.299521 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:18.299944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:18.439097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:18.447021 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a204e8e0-d916-4c2f-b61a-587b82dd7050 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.161404 Oct 10 12:11:18.447596 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 216/384] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:18 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:19.472158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:19.473078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:19.480009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:19.480501 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:19.480947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:19.481656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:19.482113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:19.482540 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:19.625834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:19.633686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f180e6d7-c848-4374-bd9f-cb4ac3c0c523 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.165642 Oct 10 12:11:19.634257 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 217/385] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:19 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:20.195280 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2f75993-c869-4314-ba00-552f7a90c38e"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:20.197788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:20.204392 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:20.204884 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:20.205322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:20.206031 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:20.206492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:20.206974 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:30.201758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=45 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:30.282710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=20 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:33.871479 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bc7efc28-e53b-41cb-8e6d-5d1b47b31970 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 26.667315 Oct 10 12:11:33.873197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 169/386] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:11:07 2022] POST /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments => generated 194 bytes in 26670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:11:33.887096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:33.887830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:33.902085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:33.902599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:33.903063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:33.903805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:33.904248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:33.904667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:33.987846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d05e9ef6-7ad6-48fc-a76a-dd2162fbe5dc tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.796270 Oct 10 12:11:33.995050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 218/387] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:11:20 2022] POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-volume_attachments => generated 194 bytes in 13798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:11:34.129702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:34.138587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-81dddf96-1ef2-4b55-a2fa-4fd8a3e68ffe tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.263638 Oct 10 12:11:34.139209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 170/388] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:33 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:34.767842 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:34.768469 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:34.775546 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:34.776032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:34.776465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:34.777162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:34.777612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:34.778033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:34.803831 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lazy-loading 'flavor' on Instance uuid 3e51573a-beab-4197-840e-a9427a52e273 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:11:35.171847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:35.172742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:35.180771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:35.181422 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:35.182100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:35.183034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:35.183559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:35.183981 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:35.342742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:35.351185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2ee3f899-7d94-4f24-879d-d8b36c8f91ab tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.186510 Oct 10 12:11:35.351773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 171/389] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:35 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:35.401954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c82a6d72-8acd-44e5-8f26-5be8ee3fd726 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/action" status: 202 len: 0 microversion: 2.20 time: 0.638203 Oct 10 12:11:35.402634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 219/390] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 10 12:11:34 2022] POST /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:11:35.416727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:35.417868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:35.427994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:35.428998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:35.429454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:35.430264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:35.430872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:35.431413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:35.541629 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-a56b77de-ce3a-48f5-843b-eab74f3d1a20 req-ac601d1c-8f41-475b-ba61-21b84100d6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60af3e29-5610-4ff4-8d88-89a3db8b6c9b", "name": "network-vif-plugged", "status": "completed", "tag": "56440d57-210b-4ebf-abeb-b3fd4d1b4d5a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:35.552697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-a56b77de-ce3a-48f5-843b-eab74f3d1a20 req-ac601d1c-8f41-475b-ba61-21b84100d6d3 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:35.553170 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-a56b77de-ce3a-48f5-843b-eab74f3d1a20 req-ac601d1c-8f41-475b-ba61-21b84100d6d3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:35.553596 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-a56b77de-ce3a-48f5-843b-eab74f3d1a20 req-ac601d1c-8f41-475b-ba61-21b84100d6d3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:35.579251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-a56b77de-ce3a-48f5-843b-eab74f3d1a20 req-ac601d1c-8f41-475b-ba61-21b84100d6d3 service nova] Creating event network-vif-plugged:56440d57-210b-4ebf-abeb-b3fd4d1b4d5a for instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b on hv-cinder-86020 Oct 10 12:11:35.579251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-a56b77de-ce3a-48f5-843b-eab74f3d1a20 req-ac601d1c-8f41-475b-ba61-21b84100d6d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034310 Oct 10 12:11:35.579251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 220/391] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:11:35.591768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:35.601050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:35.602994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:35.604717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8202bc01-b324-4565-a148-14b391dd4718 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.195573 Oct 10 12:11:35.605312 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 172/392] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:35 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:11:36.376514 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:36.377228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:36.383944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:36.384483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:36.384977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:36.385691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:36.386148 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:36.386577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:36.539676 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:36.547917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-81a0cb74-d218-4e62-ab46-9f778640a61e tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.176314 Oct 10 12:11:36.548501 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 221/393] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:36 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:36.630561 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:36.631249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:36.637777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:36.640952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:36.640952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:36.640952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:36.640952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:36.641339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:36.776110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:36.784525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:36.785979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:36.787198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d064e78e-c80f-4d9f-b721-f1a1e6ba6eaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.160647 Oct 10 12:11:36.787788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 173/394] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:36 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:37.205305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:37.205822 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:37.212131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:37.212734 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:37.213048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:37.213779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:37.214230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:37.214657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:37.348745 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lazy-loading 'services' on Instance uuid f411d6a5-3966-4066-83a4-5499708446b4 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:11:37.570909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:37.571545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:37.577891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:37.578404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:37.583602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:37.583602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:37.583602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:37.583602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:37.608843 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8f4d1c40-82d8-4b17-bf38-929195b1465c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4/os-volume_attachments/9d8bb2ce-b0c8-4b4a-b395-cb063c7596d8" status: 202 len: 0 microversion: 2.1 time: 0.407301 Oct 10 12:11:37.609955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 222/395] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:11:37 2022] DELETE /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4/os-volume_attachments/9d8bb2ce-b0c8-4b4a-b395-cb063c7596d8 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:11:37.727203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:37.742183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4f107deb-7e69-457d-95b0-9072092812f7 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.174887 Oct 10 12:11:37.743260 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 174/396] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:37 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:37.812933 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:37.813619 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:37.819773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:37.820245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:37.820674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:37.821359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:37.821808 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:37.822230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:37.959332 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:37.967665 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:37.969764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:37.970983 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1ad4b7e7-8a77-4781-ace8-1993e698eeaa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.162307 Oct 10 12:11:37.971549 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 223/397] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:37 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:38.766803 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:38.767777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:38.774879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:38.775373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:38.775809 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:38.776516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:38.776972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:38.777399 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:38.930920 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:38.939491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b065e3f4-f7e8-4f25-993a-f4469920f49c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1313 microversion: 2.1 time: 0.177324 Oct 10 12:11:38.940077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 175/398] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:38 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:38.996012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:38.996526 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:39.003854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:39.004344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:39.004780 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:39.005510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:39.005963 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:39.006389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:39.144226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:39.152820 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:39.154314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:39.155545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-69627bcb-57fb-4cbf-be9d-276c7ac66113 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.163512 Oct 10 12:11:39.156626 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 224/399] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:38 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:11:39.491041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-65161867", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1382985420", "security_groups": [{"name": "tempest-secgroup-smoke-390021896"}], "block_device_mapping_v2": [{"uuid": "8a673810-fcf0-4f5e-a261-159d410dfcac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "467adefb-be40-4a7b-be51-41e12ba7cbdd"}]}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:39.609526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] validate_networks() for [('467adefb-be40-4a7b-be51-41e12ba7cbdd', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:11:39.963528 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:39.964389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:39.970776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:39.971265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:39.971709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:39.972423 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:39.972877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:39.973304 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:40.002760 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:11:40.003596 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:11:40.004235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:11:40.004738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:11:40.005451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:11:40.016710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:40.017217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:40.017704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:40.018486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:40.019053 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:40.019492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:40.038470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Getting quotas for project 26773079b6914a20ab27109b0dec496a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:11:40.043202 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Getting quotas for user 21c537b0fefe4fb1b51483ac0e3cf2d1 and project 26773079b6914a20ab27109b0dec496a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:11:40.107158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:11:40.109884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a673810-fcf0-4f5e-a261-159d410dfcac',volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:11:40.144786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:40.153344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8aae5bd8-baa6-496b-9290-6fdfb679daf4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1496 microversion: 2.1 time: 0.194304 Oct 10 12:11:40.154071 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 225/400] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:39 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1496 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:40.200095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:40.200701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:40.207411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:40.208212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:40.208468 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:40.209169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:40.209619 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:40.210044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:40.363093 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:40.372715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:40.374957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:40.376024 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-240de190-a307-42a2-a60c-2dac8c240f0d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.180241 Oct 10 12:11:40.376617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 226/401] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:40 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:11:40.602780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8afff770-5a81-409f-bb2b-d2db75cea4aa tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117546 Oct 10 12:11:40.603598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 176/402] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:11:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:11:40.615691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bce1a868-0045-4c7f-bb0d-4aa5812ac095 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:40.616297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bce1a868-0045-4c7f-bb0d-4aa5812ac095 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:40.673575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bce1a868-0045-4c7f-bb0d-4aa5812ac095 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:40.681477 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bce1a868-0045-4c7f-bb0d-4aa5812ac095 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1093 microversion: 2.1 time: 0.069687 Oct 10 12:11:40.682416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 227/403] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:40 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:41.402225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:41.402866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:41.409257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:41.409759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:41.410188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:41.410956 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:41.411454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:41.411880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:41.570089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:41.581330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:41.582829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:41.584023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-53d6f29b-42e8-431f-a74e-0c0278e4e60d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.186431 Oct 10 12:11:41.584643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 177/404] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:41 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:41.705442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e476bd03-d2a6-4327-b7e6-10f7a888bd51 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:41.706101 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e476bd03-d2a6-4327-b7e6-10f7a888bd51 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:41.762938 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e476bd03-d2a6-4327-b7e6-10f7a888bd51 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:41.770732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e476bd03-d2a6-4327-b7e6-10f7a888bd51 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1093 microversion: 2.1 time: 0.069070 Oct 10 12:11:41.771182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 228/405] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:41 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:41.801930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:41.802886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:41.809458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:41.813471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:41.813471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:41.813471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:41.813471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:41.813863 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:41.840312 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:11:42.252058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-70afc74d-a193-475b-ac74-ffa57040f274 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 204 len: 0 microversion: 2.1 time: 0.453411 Oct 10 12:11:42.253104 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 178/406] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:11:41 2022] DELETE /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:11:42.264647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:42.265674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:42.274208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:42.275032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:42.275760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:42.276915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:42.277667 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:42.278390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:42.424842 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:42.432568 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e23aab32-95a4-46a3-acf9-b8e3fa1b8af4 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.174595 Oct 10 12:11:42.433126 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 229/407] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:42 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:42.612168 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:42.613257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:42.626524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:42.626524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:42.626524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:42.626524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:42.627118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:42.627118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:42.785403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:42.792997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:42.793612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:42.794516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:42.796060 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:42.797729 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-93238d26-2bcb-4618-a36a-0c89a6a08eb6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.191538 Oct 10 12:11:42.798468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 179/408] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:42 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:42.812874 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:42.813533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:42.814103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:42.814886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:42.815410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:42.815840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:42.881348 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:42.889461 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ad26de2b-2da5-4877-9ec3-97adf21ae58e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.100192 Oct 10 12:11:42.890059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 230/409] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:42 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:43.456627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:43.457240 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:43.464197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:43.464727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:43.465174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:43.466013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:43.466592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:43.467167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:43.608661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:43.617057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8759fe71-e6b5-4a7a-acde-886a6d38e4b2 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.164437 Oct 10 12:11:43.617634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 180/410] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:43 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:43.824823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:43.825664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:43.837034 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:43.837897 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:43.838519 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:43.839828 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:43.840663 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:43.841493 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:43.913034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:43.913837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:43.921868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:43.922468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:43.922972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:43.923745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:43.924200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:43.924631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:44.007840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:44.012754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:44.016248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b46173b9-c0c1-408d-b8f7-454d28108dcb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.106607 Oct 10 12:11:44.016835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 181/411] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:43 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:44.021559 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:44.023009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:44.024161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-65dc0511-80dd-482d-b717-2303df914778 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.204172 Oct 10 12:11:44.025599 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 231/412] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:43 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:44.639973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:44.640607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:44.647594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:44.647892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:44.648336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:44.649068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:44.649525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:44.649964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:44.792860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:44.801267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4c1260ba-0e21-4507-81b2-902eff94b035 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.165295 Oct 10 12:11:44.801853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 182/413] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:44 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:45.039926 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:45.040572 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:45.049429 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:45.050165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:45.050612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:45.051069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:45.051528 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:45.051837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:45.052029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:45.053798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:45.059229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:45.059711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:45.060234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:45.061078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:45.061601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:45.062038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:45.133617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:45.143686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-84622c87-08fb-4027-9997-506d95739c90 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.107546 Oct 10 12:11:45.159309 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 232/414] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:45 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:45.270145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:45.279157 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:45.280615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:45.281910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c399bce0-89d7-4951-a0c0-2804a62a327c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.236166 Oct 10 12:11:45.282484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 183/415] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:45 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:45.828691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:45.829298 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:45.835367 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:45.835846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:45.836282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:45.836967 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:45.837421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:45.837844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:45.977769 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:45.986512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-39bd7f00-3796-44b3-8824-b47e58f4a1c1 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.161660 Oct 10 12:11:45.987120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 233/416] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:45 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:46.167328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:46.167993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:46.174517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:46.175051 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:46.175473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:46.176176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:46.176621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:46.177041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:46.181914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:46.244007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:46.251785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-46ca6eef-628b-429d-ae1a-19aa7a178c88 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.088339 Oct 10 12:11:46.252349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 184/417] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:46 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:46.312029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:46.313219 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:46.323858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:46.324824 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:46.325324 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:46.326578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:46.327429 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:46.328703 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:46.336691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:46.489060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:46.500735 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:46.502615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:46.503584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a7a08652-cb7f-4abb-a9b0-15bf20d776da tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.199179 Oct 10 12:11:46.504159 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 234/418] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:46 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:47.009932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:47.010550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:47.017479 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:47.018031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:47.018469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:47.019207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:47.019664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:47.020094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:47.155594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:47.163549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6017b290-2e0a-48fe-b978-70b7bfe4d1cb tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.157622 Oct 10 12:11:47.164131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 185/419] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:47 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:47.276504 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:47.277131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:47.284268 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:47.284767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:47.285208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:47.285915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:47.286369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:47.286823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:47.351802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:47.360984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-abcba028-fbf7-4a81-8ebb-de7270e3f5f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.088752 Oct 10 12:11:47.362498 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 235/420] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:47 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:47.532648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:47.533298 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:47.540170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:47.540657 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:47.541096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:47.541797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:47.542252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:47.542701 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:47.684466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:47.693077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:47.694535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:47.695757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-614ca757-2a5e-4ed4-852d-35219c092958 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.168128 Oct 10 12:11:47.696326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 186/421] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:47 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:48.187876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:48.188486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:48.194644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:48.195165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:48.195628 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:48.196296 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:48.196747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:48.197173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:48.333432 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:48.344466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fa9ddf48-2ca5-4ab4-8a7b-5304a2fbb4da tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.160759 Oct 10 12:11:48.345131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 236/422] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:48 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:48.389137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:48.390274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:48.400746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:48.401547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:48.402268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:48.403573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:48.404425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:48.405169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:48.476819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:48.492414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bd342741-d57f-4b8a-8b5e-d48964ec17eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.110673 Oct 10 12:11:48.493012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 187/423] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:48 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:48.722625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:48.723253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:48.729775 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:48.730264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:48.730728 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:48.731441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:48.731895 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:48.732319 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:48.895331 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:48.903948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:48.905408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:48.907141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-81c5f8bf-51bb-43f8-9df5-bf073fc15230 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.189363 Oct 10 12:11:48.907713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 237/424] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:48 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:11:49.368984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:49.369575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:49.376199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:49.376683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:49.377114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:49.377814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:49.378257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:49.378692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:49.516403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:49.517624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:49.524525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:49.524695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:49.525010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:49.525458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:49.526166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:49.526627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:49.527142 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:49.534328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ede60e54-a232-4911-9e07-b7c64204dd67 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.169239 Oct 10 12:11:49.534964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 188/425] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:49 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:49.591748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:49.599961 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8fb42eaf-b81e-4ca3-a038-94b37bceb0ea tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.088084 Oct 10 12:11:49.600533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 238/426] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:49 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:49.933514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:49.934124 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:49.944689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:49.945327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:49.945657 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:49.946367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:49.946865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:49.947294 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:50.027972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:50.050645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=6 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:50.117351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:50.127004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:50.128492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:50.129892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5740e6b8-111a-4023-8d39-5aefc17a7a66 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.200317 Oct 10 12:11:50.130649 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 189/427] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:49 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:50.559343 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:50.562232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:50.571593 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:50.572250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:50.573365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:50.574152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:50.574877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:50.575568 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:50.621565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:50.622336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:50.629791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:50.630314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:50.630787 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:50.631577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:50.632035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:50.632466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:50.710574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:50.719334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fe5d19c6-cde5-4226-a3c9-aa90f1f55495 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.100917 Oct 10 12:11:50.719924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 190/428] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:50 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:50.754708 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:50.763494 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8dd3f40a-8209-486e-9733-ad9cf9002269 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.209848 Oct 10 12:11:50.766190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 239/429] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:50 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:51.173534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:51.174168 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:51.180305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:51.180785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:51.181215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:51.181898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:51.182343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:51.182791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:51.336623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:51.345547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:51.346930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:51.348201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-72d57fa5-1147-4ac2-8da6-3ae8c9cd0679 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.178508 Oct 10 12:11:51.348716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 191/430] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:51 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:51.742522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:51.743164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:51.750341 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:51.750859 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:51.751295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:51.752010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:51.752460 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:51.752887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:51.769720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=4 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:51.799372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:51.801510 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:51.813003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:51.814178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:51.815009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:51.816189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:51.817162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:51.818019 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:51.836710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:51.849331 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ba713f76-f22e-4c07-ace4-478a35c7fea1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1143 microversion: 2.1 time: 0.110407 Oct 10 12:11:51.850488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 240/431] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:51 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1143 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:52.019161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:52.031793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8a8342e8-0333-425f-9f77-9e9c5ca450e5 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.245871 Oct 10 12:11:52.032764 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 192/432] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:51 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:52.379966 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:52.381048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:52.393430 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:52.394314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:52.395152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:52.396246 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:52.397084 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:52.397851 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:52.571072 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:52.580331 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:52.581835 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:52.583185 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-93ca9f1b-774a-4aef-a5e1-c40d312dda6d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.211397 Oct 10 12:11:52.584990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 241/433] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:52 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:52.874108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:52.874745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:52.881929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:52.882412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:52.882896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:52.883588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:52.884038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:52.884463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:52.950896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:52.960357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5dde1093-0b70-4ac8-80b6-313175a93d9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1135 microversion: 2.1 time: 0.090271 Oct 10 12:11:52.960943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 193/434] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:52 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1135 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:53.056050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:53.057286 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:53.064392 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:53.064928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:53.065394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:53.066062 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:53.066989 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:53.067503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:53.224756 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:53.233305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ab1ebe1e-d9e0-4cd9-8754-08535d006611 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.181124 Oct 10 12:11:53.233923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 242/435] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:53 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:53.610424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:53.611070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:53.617599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:53.618096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:53.618531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:53.619288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:53.619736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:53.624233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:53.799485 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:53.808274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:53.809981 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:53.811205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1945ea32-8e0e-4ddc-aa5c-296930076537 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.205452 Oct 10 12:11:53.811769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 194/436] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:53 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:53.988636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:53.989755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:54.000494 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:54.001628 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:54.002542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:54.004010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:54.004787 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:54.005533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:54.083281 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:54.096259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-80946d8c-7844-4168-b18f-9fe1e2c8aaa6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1191 microversion: 2.1 time: 0.114305 Oct 10 12:11:54.097282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 243/437] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:53 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:54.260893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:54.261587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:54.268460 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:54.268954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:54.280409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:54.282166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:54.282691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:54.283516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:54.503189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:54.522200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1d6471ec-70e0-4a65-b235-3b6a965c2dec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1502 microversion: 2.1 time: 0.264730 Oct 10 12:11:54.523618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 195/438] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:54 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:54.724203 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a8b7264d-fb59-4f71-917b-db4d87528d32 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: .version_select at 0x7f6d12acd040>, body: {"keypair": {"name": "tempest-keypair-1877456162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChourBNcPOGVan5adp4bTRfvzh2svfOXhdXXDbS4Pn3I/KjGzQ8nmgbJfuini0hVDbeaI1alW6wF7D+6TtsEtxgo9u/hY+rSHQ8uwcb7kJ7/oxfKUT0mxFI46F2e416AA=="}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:54.749044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-a8b7264d-fb59-4f71-917b-db4d87528d32 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:11:54.754620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-a8b7264d-fb59-4f71-917b-db4d87528d32 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:11:54.839209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:54.839411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:54.846166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:54.846652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:54.847107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:54.847816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:54.848265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:54.848688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:54.869592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a8b7264d-fb59-4f71-917b-db4d87528d32 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154155 Oct 10 12:11:54.870630 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 244/439] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:11:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:11:54.907454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-b9c22752-8e7d-4669-b96d-c28219a2804f req-6a4fa298-2961-4c55-af7a-2044b0bbd64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60af3e29-5610-4ff4-8d88-89a3db8b6c9b", "name": "network-vif-deleted", "tag": "56440d57-210b-4ebf-abeb-b3fd4d1b4d5a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:54.924849 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b9c22752-8e7d-4669-b96d-c28219a2804f req-6a4fa298-2961-4c55-af7a-2044b0bbd64f service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:54.925503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b9c22752-8e7d-4669-b96d-c28219a2804f req-6a4fa298-2961-4c55-af7a-2044b0bbd64f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:54.926130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b9c22752-8e7d-4669-b96d-c28219a2804f req-6a4fa298-2961-4c55-af7a-2044b0bbd64f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:54.939869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-b9c22752-8e7d-4669-b96d-c28219a2804f req-6a4fa298-2961-4c55-af7a-2044b0bbd64f service nova] Creating event network-vif-deleted:56440d57-210b-4ebf-abeb-b3fd4d1b4d5a for instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b on hv-cinder-86020 Oct 10 12:11:54.945308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-b9c22752-8e7d-4669-b96d-c28219a2804f req-6a4fa298-2961-4c55-af7a-2044b0bbd64f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044137 Oct 10 12:11:54.945922 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 245/440] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:11:55.045286 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:55.063334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:55.066393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:55.068676 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-82c8c3ec-c553-40cf-a8ee-512de3f6b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.234071 Oct 10 12:11:55.070249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 196/441] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:54 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:55.122099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:55.122802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:55.130793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:55.131332 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:55.131811 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:55.132552 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:55.133013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:55.133494 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:55.205210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:55.213604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3ab4406f-edf6-4020-a366-28e60c5f01e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1191 microversion: 2.1 time: 0.096028 Oct 10 12:11:55.214320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 246/442] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:55 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:55.559394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:55.560019 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:55.566805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:55.567297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:55.567810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:55.568531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:55.568992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:55.569424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:55.603479 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:55.604004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:55.604446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:55.604900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lazy-loading 'fault' on Instance uuid 60af3e29-5610-4ff4-8d88-89a3db8b6c9b {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:11:55.667268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:55.676977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-750a1a7f-774e-483f-8855-8e91e62495ec tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1303 microversion: 2.1 time: 0.121601 Oct 10 12:11:55.677927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 197/443] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:55 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:56.115629 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:56.116515 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:56.123359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:56.124016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:56.124482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:56.125180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:56.125688 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:56.126113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:56.236998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:56.237749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:56.245105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:56.245832 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:56.246453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:56.247550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:56.248213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:56.254826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:56.339220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:56.342415 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:56.347557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-31565ab9-e3bd-4773-9202-3e1549cae538 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1199 microversion: 2.1 time: 0.114533 Oct 10 12:11:56.348434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 198/444] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:56 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1199 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:11:56.366007 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:56.367587 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:56.369109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-aeb716d4-a138-40a8-b43d-cff4bb42a6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.257392 Oct 10 12:11:56.370264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 247/445] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:56 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:56.711352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:56.715049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:56.721031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:56.722488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:56.723234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:56.724583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:56.725266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:56.725965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:56.766477 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:56.766942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:56.767388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:56.767846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lazy-loading 'fault' on Instance uuid 60af3e29-5610-4ff4-8d88-89a3db8b6c9b {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:11:56.821524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd58683f7689a4356badd8f4bb30850a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4326aa9c66954652943d3754b121bce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:56.829941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-24e420f8-3b94-463b-a007-3d2a466b1ab0 tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 200 len: 1303 microversion: 2.1 time: 0.123737 Oct 10 12:11:56.830614 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 199/446] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:56 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:57.376992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:57.378323 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:57.409299 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:57.410373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:57.414853 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:57.416047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:57.416730 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:57.417955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:57.418832 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:57.420081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:57.428552 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:57.436834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:57.438181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:57.439172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:57.440984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:57.447528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:57.449002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:57.531826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:57.823348 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:57.838124 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:57.839104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-65b1ab87-8207-4073-8b0d-8046937b51eb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.469258 Oct 10 12:11:57.840674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 248/447] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:57 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:57.862102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:57.863060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] [instance: 60af3e29-5610-4ff4-8d88-89a3db8b6c9b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:57.867060 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:57.869018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:57.870454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e35386e2-0f1b-4425-beb7-37a26e6c4f43 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.477762 Oct 10 12:11:57.876710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:57.877885 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:57.879305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:57.880798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:57.883516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:57.889664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:57.889878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 200/448] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:57 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:11:57.899799 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] HTTP exception thrown: Instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b could not be found. Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Request method failure captured: Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b HTTP/1.1 Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAuR08e8sTG2wW0ob893Z4yFLoePyJfLwtfzHRl1NegSjdUHNHoIwucz7h-qZkTG1cp2pp_0YDEOg6zmSDIhxPs0Sa5iAp9sHtnBcfa64gMBx6NsNVg_W3dNFCKposssGuBStUUuMJmeYnnqkwtjqC7g-qKnYfvdt5jBlHIXgy4dYNA Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: 4326aa9c66954652943d3754b121bce8 Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-VolumesActionsTest-1379031834 Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:11:57.901616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4326aa9c66954652943d3754b121bce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4326aa9c66954652943d3754b121bce8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4326aa9c66954652943d3754b121bce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4326aa9c66954652943d3754b121bce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-VolumesActionsTest-1379031834 Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: 4326aa9c66954652943d3754b121bce8 Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-VolumesActionsTest-1379031834 Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-VolumesActionsTest-1379031834-project Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: d58683f7689a4356badd8f4bb30850a5 Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-VolumesActionsTest-1379031834-project Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b could not be found. Oct 10 12:11:57.908310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': '60af3e29-5610-4ff4-8d88-89a3db8b6c9b'} Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b could not be found. Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:11:57.909913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b could not be found. Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b could not be found. Oct 10 12:11:57.912616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:11:57.915379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] Returning 404 to user: Instance 60af3e29-5610-4ff4-8d88-89a3db8b6c9b could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:11:57.915379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f7879bb9-c1b0-4bc7-b2dc-1ccc5ac0111c tempest-VolumesActionsTest-1379031834 tempest-VolumesActionsTest-1379031834-project] 10.222.0.46 "GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b" status: 404 len: 111 microversion: 2.1 time: 0.045989 Oct 10 12:11:57.915379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 249/449] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:57 2022] GET /compute/v2.1/servers/60af3e29-5610-4ff4-8d88-89a3db8b6c9b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:11:58.446939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-7960c6d1-ea4e-473f-bf81-75ae60a9550b req-d4bd100b-b034-4097-bf92-729ea2db9e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f92846d-2cb9-4e32-ae7a-a5a7d775bc36", "tag": "25362498-cffe-413c-a09b-5810fd5593c4"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:58.463019 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7960c6d1-ea4e-473f-bf81-75ae60a9550b req-d4bd100b-b034-4097-bf92-729ea2db9e36 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:58.463904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7960c6d1-ea4e-473f-bf81-75ae60a9550b req-d4bd100b-b034-4097-bf92-729ea2db9e36 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:58.464508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7960c6d1-ea4e-473f-bf81-75ae60a9550b req-d4bd100b-b034-4097-bf92-729ea2db9e36 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:58.480035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-7960c6d1-ea4e-473f-bf81-75ae60a9550b req-d4bd100b-b034-4097-bf92-729ea2db9e36 service nova] Creating event network-changed:25362498-cffe-413c-a09b-5810fd5593c4 for instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 on hv-cinder-86020 Oct 10 12:11:58.489395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-7960c6d1-ea4e-473f-bf81-75ae60a9550b req-d4bd100b-b034-4097-bf92-729ea2db9e36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046166 Oct 10 12:11:58.490189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 201/450] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:11:58.595340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-652683202", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f74af49-8f08-437e-8de8-52cf94d07154"}], "security_groups": [{"name": "tempest-securitygroup--1385650436"}], "key_name": "tempest-keypair-1877456162", "user_data": "}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:11:58.712991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] validate_networks() for [('3f74af49-8f08-437e-8de8-52cf94d07154', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:11:58.870119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:58.873449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:58.880663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:58.881566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:58.882258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:58.883032 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:58.883487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:58.893234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:59.328310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:59.362279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-895e4385-0080-4c61-ab87-ddbe59dd6e00 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.496498 Oct 10 12:11:59.363209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 202/451] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:58 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:11:59.373274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:59.374372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:59.384292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:59.384843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:59.385287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:59.386207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:59.386862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:59.387486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:59.553757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:11:59.555521 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:11:59.556676 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:11:59.557667 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:11:59.559830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:11:59.583736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:59.585497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:59.586488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:59.588503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:11:59.590393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:11:59.591037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:11:59.647556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:59.648471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:11:59.653675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:11:59.667634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:59.670040 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Going to run 1 instances... {{(pid=121298) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:11:59.671910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:59.673682 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:11:59.674866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-39296b41-0545-40ce-9fd3-cd956149df82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.309815 Oct 10 12:11:59.692815 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 203/452] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:11:59 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:11:59.827351 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-998e182c-a78e-46dd-8a8b-7c9dfebddd5f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.236673 Oct 10 12:11:59.834586 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 250/453] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:11:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:11:59.867945 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b56c355c-f1c4-4e0d-81a0-d8b647fa77ab tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:11:59.868582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b56c355c-f1c4-4e0d-81a0-d8b647fa77ab tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:11:59.973427 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b56c355c-f1c4-4e0d-81a0-d8b647fa77ab tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:11:59.982465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b56c355c-f1c4-4e0d-81a0-d8b647fa77ab tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1241 microversion: 2.1 time: 0.142080 Oct 10 12:11:59.996598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 204/454] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:11:59 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:00.388729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:00.389353 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:00.391624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:00.396922 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:00.397415 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:00.397855 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:00.398571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:00.399085 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:00.399701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:00.550439 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:00.568324 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fe97c7c3-414c-4956-b53b-afff0c7e4633 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.183549 Oct 10 12:12:00.568948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 251/455] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:00 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:00.725031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:00.725668 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:00.731922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:00.732409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:00.732851 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:00.733592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:00.734714 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:00.735249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:00.876575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:00.886468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:00.888025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:00.889216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7ed77c91-664a-40b7-9c2a-e2f6ab3f5fd1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.168405 Oct 10 12:12:00.889770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 205/456] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:00 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:01.008379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:01.009053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:01.016286 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:01.016770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:01.017209 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:01.017911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:01.018379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:01.018838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:01.102766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:01.117311 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-84dd9f17-86fb-4ca3-b31b-a42f9e46ab60 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.108739 Oct 10 12:12:01.117311 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 252/457] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:01 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:01.519095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-eb6641f7-fe73-4323-be0d-7fba3a59c43e req-7d7dd765-c6c8-4072-9d07-a9595d35a5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51573a-beab-4197-840e-a9427a52e273", "name": "network-vif-plugged", "status": "completed", "tag": "98e81f6a-0ff4-4344-ab00-e77663d7f2cf"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:01.529850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-eb6641f7-fe73-4323-be0d-7fba3a59c43e req-7d7dd765-c6c8-4072-9d07-a9595d35a5ca service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:01.530188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-eb6641f7-fe73-4323-be0d-7fba3a59c43e req-7d7dd765-c6c8-4072-9d07-a9595d35a5ca service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:01.530616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-eb6641f7-fe73-4323-be0d-7fba3a59c43e req-7d7dd765-c6c8-4072-9d07-a9595d35a5ca service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:01.543741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-eb6641f7-fe73-4323-be0d-7fba3a59c43e req-7d7dd765-c6c8-4072-9d07-a9595d35a5ca service nova] Creating event network-vif-plugged:98e81f6a-0ff4-4344-ab00-e77663d7f2cf for instance 3e51573a-beab-4197-840e-a9427a52e273 on hv-cinder-86020 Oct 10 12:12:01.549613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-eb6641f7-fe73-4323-be0d-7fba3a59c43e req-7d7dd765-c6c8-4072-9d07-a9595d35a5ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035943 Oct 10 12:12:01.550235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 206/458] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:12:01.592971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:01.593707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:01.604910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:01.605692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:01.606139 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:01.606932 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:01.607393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:01.607825 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:01.774973 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:01.778480 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:01.783482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a9adb0c0-30b8-446e-b433-1447b2a26ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.195421 Oct 10 12:12:01.784072 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 253/459] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:01 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:01.914756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:01.916107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:01.935214 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:01.939540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:01.939540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:01.939540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:01.939540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:01.940136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:02.099896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:02.109155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:02.111272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:02.112469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-092dca56-1663-4c23-8925-3945b126c8b4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.202668 Oct 10 12:12:02.113028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 207/460] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:01 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:02.142995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:02.144272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:02.157400 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:02.158345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:02.159134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:02.160357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:02.161476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:02.162176 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:02.264354 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:02.274343 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-321ffdf4-3983-4a57-b5cd-6596c5a0931e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.139137 Oct 10 12:12:02.274915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 254/461] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:02 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:02.806192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:02.806901 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:02.813260 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:02.813758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:02.814201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:02.814960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:02.815421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:02.815858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:02.966328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:02.979525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-678a58b1-ab2c-4828-b653-eb10662ded38 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.176797 Oct 10 12:12:02.980524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 208/462] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:02 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:03.140395 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:03.141061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:03.148698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:03.149391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:03.149648 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:03.150350 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:03.150830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:03.151256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:03.307384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:03.314171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:03.340404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:03.341774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:03.342328 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:03.342564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:03.343520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:03.344109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:03.344791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:03.360800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:03.365282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:03.367933 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1c48ca55-e1ec-4f18-bae8-e32cf646b812 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.231853 Oct 10 12:12:03.369326 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 255/463] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:03 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:03.430029 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:03.443027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-17835e9c-cb13-46cd-9749-35aca1507431 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.144791 Oct 10 12:12:03.451444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 209/464] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:03 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:04.008454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:04.009975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:04.021972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:04.023271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:04.024105 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:04.025386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:04.026298 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:04.027141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:04.203118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:04.211209 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c028292e-a7df-41fd-9380-815c804f17e7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.210562 Oct 10 12:12:04.211802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 256/465] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:03 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:04.393661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:04.394425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:04.405217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:04.405217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:04.405217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:04.405217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:04.405550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:04.405550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:04.484450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:04.492763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:04.509300 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:04.510160 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:04.511525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:04.513131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:04.513973 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:04.515000 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:04.596917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:04.605011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-54f71689-1442-43c7-bfee-03484fde3548 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.135471 Oct 10 12:12:04.605351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:04.605592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 257/466] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:04 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:04.621305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:04.624125 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:04.626315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c4b8e5c5-119d-4577-b432-746f8d9d380b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.236492 Oct 10 12:12:04.627355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 210/467] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:04 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:05.234897 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:05.235639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:05.243193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:05.243757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:05.244241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:05.244999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:05.245578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:05.246064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:05.389952 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:05.405173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0b616f15-0a29-4f0e-9e6f-2f82f3833500 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.173773 Oct 10 12:12:05.406284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 258/468] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:05 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:05.629154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:05.633089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:05.637146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:05.637656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:05.638078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:05.638818 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:05.639279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:05.639708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:05.670573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:05.671208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:05.678007 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:05.678840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:05.679513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:05.680211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:05.680662 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:05.681081 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:05.704985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:05.712839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-93417c6d-a017-4773-9298-0e0110ada62d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.088085 Oct 10 12:12:05.722699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 211/469] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:05 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:05.822002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:05.829605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:05.831097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:05.832240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0c61a77d-d340-4aed-bf3d-28b6ef2c5d61 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.166500 Oct 10 12:12:05.832800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 259/470] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:05 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:06.431967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:06.432584 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:06.439128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:06.439623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:06.440074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:06.440786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:06.441241 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:06.441669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:06.585246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:06.594872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3428d5cf-6f9e-400b-bdf7-87e60589f4ce tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.166636 Oct 10 12:12:06.597044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 212/471] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:06 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:06.739283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:06.739917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:06.746970 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:06.747461 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:06.747900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:06.748613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:06.749057 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:06.749479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:06.817522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:06.826344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b1585d6c-118b-4e6f-9fa7-9cdfce0b547b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.090861 Oct 10 12:12:06.836632 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 260/472] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:06 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:06.857531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:06.858162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:06.864855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:06.865357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:06.865800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:06.866510 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:06.867007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:06.867437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:07.007306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:07.015891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:07.017887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:07.019098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-afc0c4e9-ea20-4548-8051-f754380577de tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.165530 Oct 10 12:12:07.019674 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 213/473] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:06 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:07.626299 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:07.627322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:07.635713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:07.636641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:07.637631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:07.638482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:07.639098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:07.639782 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:07.792314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:07.800473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8090291a-83a0-49ef-b9b6-689194622886 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.179764 Oct 10 12:12:07.801057 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 261/474] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:07 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:07.849917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:07.850577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:07.857307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:07.857871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:07.858489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:07.859126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:07.860249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:07.860794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:07.932783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:07.941838 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5f9ad7f5-f104-45f3-a141-05c1654ee0e6 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.095998 Oct 10 12:12:07.942425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 214/475] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:07 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:08.045118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:08.045777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:08.052744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:08.053226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:08.053659 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:08.054365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:08.054844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:08.055263 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:08.199535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:08.209479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:08.211221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:08.212740 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2546fab6-fe8f-4f63-a35e-474e7b753db5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.171460 Oct 10 12:12:08.213402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 262/476] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:08 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:08.824895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:08.825795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:08.833475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:08.834103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:08.834893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:08.835783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:08.836341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:08.836831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:08.969758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:08.971033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:08.982906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:08.983759 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:08.984535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:08.985704 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:08.986223 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:08.986806 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:08.988221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:08.997339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-76f9d385-136f-4c4f-94d8-051ec24cbfbb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.177066 Oct 10 12:12:08.997934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 215/477] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:08 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:09.056689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:09.065720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9781c20d-f56f-47e2-a327-63646a5ab3b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.103440 Oct 10 12:12:09.066314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 263/478] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:08 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:09.240039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:09.240572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:09.247248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:09.247742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:09.248210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:09.249094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:09.249588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:09.250163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:09.417667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:09.433429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:09.436370 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:09.438823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e96d4621-efc2-44f7-bef8-8839b9480c8e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.201964 Oct 10 12:12:09.439872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 216/479] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:09 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:10.021527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:10.022208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:10.024232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:10.024935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=10 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:10.031257 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:10.032462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:10.032933 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:10.033670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:10.034135 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:10.034573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:10.091137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:10.091863 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:10.096554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:10.102082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:10.102748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:10.103100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:10.103851 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:10.104310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:10.104742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:10.180271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:10.190288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d1ce1a7d-3cea-4384-a65b-0710755064d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.103409 Oct 10 12:12:10.190934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 217/480] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:10 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:10.235269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:10.244864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-16f900c9-f9b7-4b9c-b884-194c5f0415d7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.227386 Oct 10 12:12:10.245551 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 264/481] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:10 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:10.464843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:10.465461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:10.473207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:10.473965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:10.474405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:10.475141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:10.475596 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:10.476021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:10.613065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:10.621414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:10.622938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:10.624092 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bc2fafc2-45ae-45a3-ab79-a5dd302c3a81 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.163448 Oct 10 12:12:10.624742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 218/482] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:10 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:11.213882 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:11.214524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:11.221879 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:11.222356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:11.223124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:11.224075 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:11.224525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:11.224940 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:11.271729 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:11.272374 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:11.280694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:11.281506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:11.282298 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:11.283614 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:11.285003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:11.286402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:11.288777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:11.293948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:11.297388 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7ae7664c-d82a-453b-b7eb-c6add5f5c13b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.087489 Oct 10 12:12:11.297983 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 265/483] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:11 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:11.458500 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:11.466885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eff20424-2ed0-459b-b686-c036af4c0f98 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.202768 Oct 10 12:12:11.467492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 219/484] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:11 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:11.651548 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:11.652200 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:11.658927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:11.659429 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:11.659880 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:11.660649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:11.661294 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:11.661731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:11.834016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:11.843167 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:11.844654 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:11.845841 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2115c42f-213b-4464-9249-d2eb1b221df7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.198510 Oct 10 12:12:11.846414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 266/485] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:11 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:12.325573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:12.326193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:12.336085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:12.336844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:12.337587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:12.338531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:12.339064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:12.339562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:12.405256 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:12.416880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-867a151a-a707-4bbf-9dde-f9a900971760 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.094868 Oct 10 12:12:12.417807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 220/486] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:12 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:12.492986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:12.493606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:12.500162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:12.500652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:12.501094 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:12.501793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:12.502247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:12.502690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:12.648744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:12.657219 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-802eb7db-6f04-4aa8-bfee-046aeaee02c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.167492 Oct 10 12:12:12.657799 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 267/487] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:12 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:12.872613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:12.873131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:12.879861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:12.880364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:12.880802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:12.881549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:12.882021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:12.882453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:13.056839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:13.071427 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:13.074229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:13.076348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-76d918d4-c1b7-49fc-959d-e79953b8f843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.207478 Oct 10 12:12:13.077440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 221/488] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:12 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:13.440980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:13.441595 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:13.447872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:13.448356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:13.448792 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:13.449497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:13.449953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:13.450382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:13.513082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:13.521068 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-05c974d8-cbb1-42ed-9115-aa6e40dcc8e1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.084610 Oct 10 12:12:13.521654 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 268/489] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:13 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:13.680862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:13.681487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:13.696222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:13.703412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:13.703412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:13.703412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:13.703412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:13.703900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:13.839381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:13.851842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9e86f38a-b804-48a3-b23c-b7d90e22e91a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.174901 Oct 10 12:12:13.852619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 222/490] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:13 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:14.112086 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:14.113050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:14.121789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:14.122920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:14.123607 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:14.124548 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:14.125010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:14.125544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:14.272357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:14.280609 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:14.282047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:14.283254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-55def561-e504-47a7-a0e4-292283406870 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.175717 Oct 10 12:12:14.283821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 269/491] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:14 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:14.544893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:14.545494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:14.552882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:14.553366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:14.553804 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:14.554498 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:14.554974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:14.555443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:14.618821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:14.627283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f94f6d3b-d489-4247-b79c-786d4662c062 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.085579 Oct 10 12:12:14.627859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 223/492] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:14 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:14.875059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:14.875694 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:14.882563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:14.883088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:14.883525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:14.884228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:14.884676 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:14.885093 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:14.904164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:15.034818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:15.043099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-eb51005a-17cb-4b21-b282-a76f50199cfc tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.171901 Oct 10 12:12:15.043687 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 270/493] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:14 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:15.308663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:15.309325 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:15.315903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:15.316395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:15.316836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:15.317579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:15.318034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:15.318463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:15.456527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:15.466122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:15.467574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:15.468739 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-090ab097-6645-4236-a620-dd2f76c1906c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.164149 Oct 10 12:12:15.469301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 224/494] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:15 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:15.649312 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:15.654318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:15.656535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:15.657009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:15.657490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:15.658687 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:15.659137 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:15.659556 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:15.725162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:15.733022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b16dd5c9-7f80-4ecc-943b-753600b8fe56 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.087460 Oct 10 12:12:15.733831 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 271/495] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:15 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:16.066165 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:16.066713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:16.072753 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:16.073233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:16.073667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:16.074357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:16.074840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:16.075270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:16.209446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:16.217867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-26de9394-eb7c-4ef8-b840-a8579f9b3363 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.156101 Oct 10 12:12:16.226747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 225/496] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:16 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:16.494270 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:16.495073 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:16.501247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:16.501786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:16.502227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:16.502965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:16.503424 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:16.503855 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:16.645132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:16.653318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:16.654763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:16.655902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8727c7c7-5a57-46b4-bb81-3494e25725a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.165603 Oct 10 12:12:16.656453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 272/497] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:16 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:16.756020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:16.756661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:16.763292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:16.763779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:16.764216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:16.764908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:16.765362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:16.765789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:16.830582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:16.838465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3084b340-edc1-4898-8809-6dd55a58ec82 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1245 microversion: 2.1 time: 0.086429 Oct 10 12:12:16.839018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 226/498] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:16 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:17.242101 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:17.245359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:17.253178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:17.259610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:17.259610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:17.259610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:17.259610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:17.260436 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:17.427070 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:17.435582 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1033791e-f915-472e-a31e-ca31ad57a59e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.197761 Oct 10 12:12:17.436300 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 273/499] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:17 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:17.683500 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:17.684119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:17.691478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:17.691969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:17.692410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:17.693118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:17.693738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:17.694184 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:17.843845 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:17.855978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:17.858326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:17.860313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-68e432e1-5ed6-4c67-a2eb-853165e78326 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.180780 Oct 10 12:12:17.865070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 227/500] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:17 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:17.865293 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:17.866094 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:17.873667 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:17.874154 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:17.874639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:17.875362 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:17.875868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:17.876955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:17.948664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:17.956831 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8199f484-42ec-4b3a-a782-cc67e7d4786e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1293 microversion: 2.1 time: 0.098436 Oct 10 12:12:17.957413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 274/501] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:17 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:18.463108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:18.463761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:18.474414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:18.475115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:18.475722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:18.476601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:18.482514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:18.483183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:18.629969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9f1df550-e2f4-40c7-a849-3435f003952f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:18.638127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f1df550-e2f4-40c7-a849-3435f003952f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:18.638627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f1df550-e2f4-40c7-a849-3435f003952f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:18.640422 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f1df550-e2f4-40c7-a849-3435f003952f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:18.676441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:18.686969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cdeff2f3-d0f2-4202-b4ff-ca2f516327a8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.227112 Oct 10 12:12:18.687452 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 228/502] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:18 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:18.741599 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9f1df550-e2f4-40c7-a849-3435f003952f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Going to try to stop instance {{(pid=121298) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 12:12:18.928718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:18.931890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:19.006362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.006362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.006362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.006362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.007070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.007070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.083600 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9f1df550-e2f4-40c7-a849-3435f003952f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action" status: 202 len: 0 microversion: 2.1 time: 0.449816 Oct 10 12:12:19.086342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 275/503] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:12:18 2022] POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:12:19.096917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:19.098161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:19.116041 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.117004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.118009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.121004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.122183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.124205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.205036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:19.220768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:19.223116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:19.225509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9e5029d4-cf1c-43aa-806b-0910219c3bea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1746 microversion: 2.20 time: 0.339523 Oct 10 12:12:19.228952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 229/504] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:18 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1746 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:19.234224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:19.236044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:19.242688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.243503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.244197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.245111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.245980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.246571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.278860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:19.288863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e3132e82-c93a-4a81-9d68-7fa0954316c5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1293 microversion: 2.1 time: 0.196430 Oct 10 12:12:19.292998 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 276/505] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:19 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:19.425158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:19.433990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f663b608-e539-410a-9504-3cfa9bf5fa8d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.203645 Oct 10 12:12:19.434821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 230/506] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:19 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:19.546994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:19.548711 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:19.561810 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.562385 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.562848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.563588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.564191 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.564815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.606546 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Going to try to terminate instance {{(pid=121298) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:12:19.710151 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:19.711122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:19.745729 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.750770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.752512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:19.753619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:19.756056 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:19.756794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.017136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:20.029460 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2f589db2-4186-4fab-aa69-2c9d04909f0c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.323518 Oct 10 12:12:20.030502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 231/507] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:19 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:20.108052 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9f665a3b-7eaa-47bd-a0fc-45628987758a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 204 len: 0 microversion: 2.1 time: 0.564783 Oct 10 12:12:20.111169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 277/508] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:12:19 2022] DELETE /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:12:20.124318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:20.126354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:20.138136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.139792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.139792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.141169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.142515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.143198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.261091 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:20.262424 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:20.283863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.288302 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.289061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.290389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.293524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.296731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.494488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:20.503595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-565aa065-57ec-4e9e-afd4-1e15c8fa75c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1514 microversion: 2.1 time: 0.388060 Oct 10 12:12:20.517568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 232/509] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:20 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:20.522094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:20.522094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:20.534355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.534906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.535437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.536049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.536492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.536910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.557536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:20.567264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:20.568774 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:20.570030 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9bcda41c-5533-4236-89c5-bf26c097892a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.314217 Oct 10 12:12:20.570718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 278/510] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:20 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:20.586789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:20.587537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:20.593917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.594492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.595050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.595840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:20.596366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:20.597139 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:20.608128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:20.617897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-abeb50c4-c7f9-485b-be56-7b7c1e1b5f07 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1311 microversion: 2.1 time: 0.112664 Oct 10 12:12:20.618494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 233/511] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:20 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:20.736252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:20.747012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5d91f336-e260-4215-ad69-665d19ec6177 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.163970 Oct 10 12:12:20.747847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 279/512] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:20 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:21.057020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:21.057917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:21.075748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:21.075748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:21.075748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:21.075748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:21.076331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:21.076331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:21.245119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:21.256313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7708c48e-06b4-4b5b-a160-7769e58f1528 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.207038 Oct 10 12:12:21.256941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 234/513] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:21 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:21.533963 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:21.535244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:21.546120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:21.547073 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:21.547816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:21.549031 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:21.549793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:21.551107 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:21.597073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:21.598062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:21.612710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:21.613326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:21.613876 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:21.614659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:21.615226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:21.615906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:22.002179 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:22.018332 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:22.026751 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:22.029820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:22.032789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:22.032789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-18f400e6-11cd-4928-870e-3f6015c0ff47 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.440259 Oct 10 12:12:22.034455 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7445b391-0cdb-4932-b3cd-536f578884c8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1514 microversion: 2.1 time: 0.508204 Oct 10 12:12:22.036909 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 280/514] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:21 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1514 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:22.041020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:22.041660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:22.054625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 235/515] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:21 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:22.064997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:22.064997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:22.064997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:22.064997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:22.065381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:22.065381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:22.068137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:22.069998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:22.076463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:22.076953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:22.077383 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:22.078394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:22.078896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:22.079489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:22.187368 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:22.198103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f38b1f72-a454-4957-8c0b-090015a642bf tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1311 microversion: 2.1 time: 0.161812 Oct 10 12:12:22.199035 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 281/516] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:22 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:22.286655 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:22.291178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:22.312304 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:22.316149 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:22.317040 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:22.324898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:22.325778 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:22.326541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:22.424009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:22.457597 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-23df5ea7-7edf-48a9-acf5-5ba062ef3ca6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.400313 Oct 10 12:12:22.488758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 236/517] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:22 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:22.700777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:22.726106 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4dfb97d8-0111-476a-b1de-da8c64743ee1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1276 microversion: 2.1 time: 0.449484 Oct 10 12:12:22.746745 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 282/518] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:22 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1276 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:23.086182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:23.086653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:23.087977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:23.091746 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:23.133409 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.139150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.140625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.150872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:23.151480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.153590 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.154868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:23.156332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.157515 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.164418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.165822 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:23.167021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:23.778757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:23.802380 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7af92627-8a88-4ebe-83c5-a80107088559 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1514 microversion: 2.1 time: 0.724099 Oct 10 12:12:23.803698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 283/519] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:23 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1514 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:23.831892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:23.832869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:23.854133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.854872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.855474 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:23.859477 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.861266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.861921 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:23.922995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:23.926115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:23.941701 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:23.946307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:23.947587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f335f445-0859-43d2-8076-beef5a816014 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.885343 Oct 10 12:12:23.962978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 237/520] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:23 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:23.967859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:23.968474 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:23.992631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.993314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.993314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:23.994405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:23.995173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:23.996058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:24.330619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:24.338076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:24.346630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7c75a7f7-5d7c-4ea0-9698-e80a02728115 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.382485 Oct 10 12:12:24.347592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b70962fb-2957-4a45-b90c-a7ca1da78f8e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.542421 Oct 10 12:12:24.352166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 238/521] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:23 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:24.357481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:24.358418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:24.363658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 284/522] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:23 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:24.366308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:24.367009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:24.367609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:24.368614 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:24.369203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:24.369771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:24.643811 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:24.652433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-58380874-81cc-4692-8964-300a8b534913 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.298822 Oct 10 12:12:24.655109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 239/523] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:24 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:24.831254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:24.832692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:24.851702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:24.852672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:24.854367 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:24.855638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:24.857905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:24.858704 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:24.977594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:24.978801 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:24.990420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:24.995057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:24.995892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:24.997690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:24.999242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:25.006209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:25.235924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:25.259307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cf596755-29d0-4799-8544-387cfa0e1409 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1514 microversion: 2.1 time: 0.432383 Oct 10 12:12:25.277055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 285/524] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:24 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1514 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:25.354718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:25.368368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:25.370226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:25.379999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:25.381003 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:25.402939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4b80738e-5ad5-40f3-915e-f40295f30a15 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.427447 Oct 10 12:12:25.406877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:25.407963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 240/525] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:24 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:25.416876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:25.420776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:25.424421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:25.425183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:25.425972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:25.429212 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:25.434350 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:25.455563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:25.456334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:25.456488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:25.460966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:25.461617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:25.462209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:25.874414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:25.883999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-60aba7b7-abfd-47ae-a51f-157a55ec4784 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.474677 Oct 10 12:12:25.884808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 241/526] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:25 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:25.896074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:25.896744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:25.921129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:25.921684 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:25.922136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:25.924486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:25.929245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:25.929833 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:25.931454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:25.973610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-215ae618-50b2-471e-be5d-1caff324f7eb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.596931 Oct 10 12:12:25.975965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 286/527] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:25 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:26.292698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:26.293911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:26.314241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:26.315072 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:26.315689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:26.316604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:26.317022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:26.317451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:26.378979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:26.390245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eb284c98-8aa1-427a-b079-383c7213d475 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.498433 Oct 10 12:12:26.392517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 242/528] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:25 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:26.434700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:26.447685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:26.454538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:26.455231 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:26.455951 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:26.456947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:26.457689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:26.458340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:26.739625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:26.752683 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5cb6a442-b368-459e-a5cd-1b0e74489e59 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1514 microversion: 2.1 time: 0.466238 Oct 10 12:12:26.758838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 287/529] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:26 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:26.792136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:26.807973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:26.810191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:26.814222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3cd4c64f-3a44-4df1-8c43-7dceccd65a45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.382158 Oct 10 12:12:26.815663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 243/530] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:26 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:26.866563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-81c5e778-f7f0-4f5a-b80e-b97b0b989b87 req-0733667b-f980-4efc-9b62-097fc8eec794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f411d6a5-3966-4066-83a4-5499708446b4", "name": "network-vif-deleted", "tag": "5a6667d5-f54b-479b-8dc6-7057368e05a2"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:26.888203 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-81c5e778-f7f0-4f5a-b80e-b97b0b989b87 req-0733667b-f980-4efc-9b62-097fc8eec794 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:26.888897 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-81c5e778-f7f0-4f5a-b80e-b97b0b989b87 req-0733667b-f980-4efc-9b62-097fc8eec794 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:26.889444 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-81c5e778-f7f0-4f5a-b80e-b97b0b989b87 req-0733667b-f980-4efc-9b62-097fc8eec794 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:26.911353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:26.916509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:26.923233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:26.927124 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:26.927722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:26.929129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:26.931634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:26.937140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:26.941974 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-81c5e778-f7f0-4f5a-b80e-b97b0b989b87 req-0733667b-f980-4efc-9b62-097fc8eec794 service nova] Creating event network-vif-deleted:5a6667d5-f54b-479b-8dc6-7057368e05a2 for instance f411d6a5-3966-4066-83a4-5499708446b4 on hv-cinder-86020 Oct 10 12:12:26.948431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-81c5e778-f7f0-4f5a-b80e-b97b0b989b87 req-0733667b-f980-4efc-9b62-097fc8eec794 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086520 Oct 10 12:12:26.955004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 288/531] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:12:27.004004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:27.004773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:27.013940 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.018227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.019051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.021424 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.023127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.023819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.444175 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:27.457167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-54e260bf-3d20-4bd5-adee-3f190021a726 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.549889 Oct 10 12:12:27.463007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 244/532] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:26 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:27.492010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:27.493712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:27.494592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:27.517874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.519091 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.519746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.520700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.521575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.522224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.541404 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9d4a68ad-cf8b-4191-9940-acc10de0cce1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.541788 Oct 10 12:12:27.549131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 289/533] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:26 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:27.777361 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:27.778388 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:27.790612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.794295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.794992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.796068 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.797087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.799136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.859541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.860121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.861119 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.861536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lazy-loading 'fault' on Instance uuid f411d6a5-3966-4066-83a4-5499708446b4 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:12:27.884493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:27.910040 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6b295633-1089-4081-ae56-8f55d719513d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.445563 Oct 10 12:12:27.910642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 245/534] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:27 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:27.925901 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:27.926946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:27.945394 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.945872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.946490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.947483 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:27.948807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:27.949462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:27.982030 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:27.992128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-54bed7c3-0a01-4eb4-8c4f-8d9d4e7de9d1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 200 len: 1309 microversion: 2.1 time: 0.219130 Oct 10 12:12:27.995064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 290/535] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:27 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:28.207386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:28.234538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:28.240274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:28.245493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-67f24257-63ba-44f6-9933-ef0267182062 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.332440 Oct 10 12:12:28.252128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 246/536] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:27 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:28.495911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:28.498132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:28.518702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:28.520175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:28.523186 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:28.525739 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:28.528112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:28.531664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:28.576787 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:28.580054 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:28.594331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:28.596107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:28.597557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:28.600318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:28.609200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:28.614068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.124884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:29.143969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c5352f2d-a5e2-4fa1-a8a9-e31f4031b234 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.572052 Oct 10 12:12:29.159227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:29.160952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 247/537] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:28 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:29.170999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:29.172691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:29.173871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-568c2243-ffb2-418a-83ce-5eaecc896b15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.687616 Oct 10 12:12:29.174883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 291/538] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:28 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:29.179629 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:29.180308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: f411d6a5-3966-4066-83a4-5499708446b4] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:29.182754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=98 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:29.184914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:29.185591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:29.186181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.187004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:29.187275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:29.187667 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:29.188042 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:29.188797 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.189289 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.189669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:29.190210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:29.190699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.206904 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] HTTP exception thrown: Instance f411d6a5-3966-4066-83a4-5499708446b4 could not be found. Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Request method failure captured: Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 HTTP/1.1 Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAuLE9tPNg3wwRyKWfwo_MNAvDMDZS49By0raDx6qxlnCMQCLw8cqT3Mk7H4QRRl_H0-FUkRV559uzeSol-hcuaPSWhBGeTry6fPOcenVjoIkXpFaM0F28-HjLaQ1Gj9ssjdPZwjXFnmF34xBu86dvAMTQe4hPjM8XjfcDh-1PEw_S8 Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: 42363f6f6a6040e5b81070350a2b7855 Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-VolumesSnapshotTestJSON-465442707 Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:12:29.212012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/42363f6f6a6040e5b81070350a2b7855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_42363f6f6a6040e5b81070350a2b7855", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42363f6f6a6040e5b81070350a2b7855"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42363f6f6a6040e5b81070350a2b7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-VolumesSnapshotTestJSON-465442707 Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: 42363f6f6a6040e5b81070350a2b7855 Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-465442707 Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-VolumesSnapshotTestJSON-465442707-project Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: 13ac3580c0164d20994d68744d9153b8 Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-VolumesSnapshotTestJSON-465442707-project Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance f411d6a5-3966-4066-83a4-5499708446b4 could not be found. Oct 10 12:12:29.214178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': 'f411d6a5-3966-4066-83a4-5499708446b4'} Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f411d6a5-3966-4066-83a4-5499708446b4 could not be found. Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:12:29.215088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f411d6a5-3966-4066-83a4-5499708446b4 could not be found. Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f411d6a5-3966-4066-83a4-5499708446b4 could not be found. Oct 10 12:12:29.216487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:12:29.218543 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Returning 404 to user: Instance f411d6a5-3966-4066-83a4-5499708446b4 could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:12:29.221768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-62f10356-205e-45dc-b417-2a97d16e23c3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4" status: 404 len: 111 microversion: 2.1 time: 0.045848 Oct 10 12:12:29.222808 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 292/539] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:29 2022] GET /compute/v2.1/servers/f411d6a5-3966-4066-83a4-5499708446b4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:12:29.228924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-9862f224-da07-4828-a260-f4c5a7f95bbb req-f7fbf009-dbbf-4faa-bcfd-c3c7bc3cfbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3", "tag": "0ced9ae0-41b3-43d6-830e-32265066d50b"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:29.249613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9862f224-da07-4828-a260-f4c5a7f95bbb req-f7fbf009-dbbf-4faa-bcfd-c3c7bc3cfbe9 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:29.250488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9862f224-da07-4828-a260-f4c5a7f95bbb req-f7fbf009-dbbf-4faa-bcfd-c3c7bc3cfbe9 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:29.251728 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9862f224-da07-4828-a260-f4c5a7f95bbb req-f7fbf009-dbbf-4faa-bcfd-c3c7bc3cfbe9 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.268313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-9862f224-da07-4828-a260-f4c5a7f95bbb req-f7fbf009-dbbf-4faa-bcfd-c3c7bc3cfbe9 service nova] Creating event network-changed:0ced9ae0-41b3-43d6-830e-32265066d50b for instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 on hv-cinder-86020 Oct 10 12:12:29.281786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-9862f224-da07-4828-a260-f4c5a7f95bbb req-f7fbf009-dbbf-4faa-bcfd-c3c7bc3cfbe9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056927 Oct 10 12:12:29.282982 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 293/540] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:12:29.289642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:29.292405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:29.304644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:29.305594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:29.307212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.308510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:29.309264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:29.310156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:29.718103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:29.734404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c5b1f48d-fd9e-471d-b8c7-228acf8f777f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.572103 Oct 10 12:12:29.735949 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 248/541] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:29 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:29.790015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:29.863486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:29.865103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:29.866329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6a626f28-34eb-4178-8703-60b072f89e45 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.582178 Oct 10 12:12:29.875524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 294/542] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:29 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:30.181705 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:30.182236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:30.190421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.201044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:30.201622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:30.206839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.208185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:30.213278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.216169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.216860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:30.217773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.219230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.222443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:30.223684 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.227518 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.228099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:30.516158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:30.527468 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d59c6124-473c-46d5-b9a3-e7adaf28375c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.330565 Oct 10 12:12:30.534821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 295/543] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:30 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:30.557034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:30.566999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e58cfc8b-24db-48f8-b71f-d12e0f09595e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.389318 Oct 10 12:12:30.567987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 249/544] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:30 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:30.758599 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:30.759375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:30.778655 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.779205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.779706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:30.780561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.780991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.781544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:30.942083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:30.946732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:30.968461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.968940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.969451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:30.970298 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:30.972837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:30.973671 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:31.414206 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:31.423490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:31.431672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e58afe4e-d2c1-4704-a1cd-61d86720d9d8 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.676975 Oct 10 12:12:31.432641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 296/545] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:30 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:31.458635 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:31.461266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:31.463389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b43e8ebf-2571-4dbe-8ef1-fe27ff5ff98f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.562561 Oct 10 12:12:31.479620 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 250/546] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:30 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:31.565972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:31.565972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:31.565972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:31.565972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:31.565972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:31.566711 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:31.567059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:31.567789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:31.568449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:31.596127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:31.596927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:31.605995 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:31.610744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:31.610744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:31.610744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:31.610744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:31.611190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:31.808368 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:31.828455 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c28c9822-a203-4675-a716-6c2d0606844b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.276453 Oct 10 12:12:31.842697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 297/547] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:31 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:31.869959 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:31.879133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-176590fe-dc91-4371-913f-9c5322634dfd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.286799 Oct 10 12:12:31.880258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 251/548] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:31 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:32.464345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:32.465758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:32.483833 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.484742 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.485454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:32.486440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.487145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.487813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:32.499127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:32.501472 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:32.520659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.525132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.525967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:32.527003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.527963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.533633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:32.563583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:32.822436 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:32.836487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c7de6b3b-e954-47b6-a8a4-166047c6aff4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.376721 Oct 10 12:12:32.837084 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 298/549] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:32 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:32.851789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:32.856827 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:32.857472 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:32.864657 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:32.867842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:32.867842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-51ba883c-5337-4754-ba4d-83e14ee02386 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.371754 Oct 10 12:12:32.877039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 252/550] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:32 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:32.878421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.878953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.879393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:32.880105 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.880563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.881014 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:32.907690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:32.908371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:32.919610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.920320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.920724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:32.921276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:32.921771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:32.922223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:33.327373 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:33.330212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a65d4af1-35ab-4c4c-8a1e-bc6ac8617710 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.476104 Oct 10 12:12:33.336981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 299/551] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:32 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:33.339246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:33.364223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f4eef979-e984-4df9-b223-676e8d79ab0c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.460763 Oct 10 12:12:33.378781 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 253/552] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:32 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:33.868760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:33.869721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:33.891997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:33.892499 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:33.893028 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:33.893749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:33.894201 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:33.894705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:33.897247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:33.898286 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:33.939766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:33.941016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:33.941016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:33.941454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:33.942414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:33.947057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:34.705940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:34.713675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:34.732692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8df3190b-2d23-4870-b59c-31a7005bc98d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.871227 Oct 10 12:12:34.733295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 300/553] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:33 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:34.744699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:34.755486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:34.756287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:34.757846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f317ec0e-80c1-44c6-a537-71ad3f13133f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.866850 Oct 10 12:12:34.758691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 254/554] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:33 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:34.767248 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:34.772631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:34.777077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:34.782215 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:34.785256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:34.785971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:34.786915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:34.788932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:34.789755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:34.790356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:34.794516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:34.799543 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:34.804609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:34.805617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:34.806384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:35.122545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:35.139916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-46d5d99c-cc59-432a-8fdc-98b625a76290 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.393866 Oct 10 12:12:35.140536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 301/555] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:34 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:35.252655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:35.262702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fd0e2b23-a460-4993-a2f7-5a2e1b4f810b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.502311 Oct 10 12:12:35.284835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 255/556] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:34 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:35.763513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:35.764538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:35.773637 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:35.774505 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:35.775336 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:35.776222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:35.776958 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:35.777544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:35.784382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:35.785250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:35.796759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:35.798130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:35.798777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:35.799680 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:35.804056 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:35.804765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:36.153074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:36.163359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:36.168827 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b0fb3205-e11f-46d3-9732-b39a0da3e3f3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.414325 Oct 10 12:12:36.199448 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 302/557] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:35 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:36.207329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:36.221026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:36.223676 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:36.225834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:36.226950 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:36.232810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7e717930-7af7-4d2b-bdce-5e6492f20f41 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.452519 Oct 10 12:12:36.235821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 256/558] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:35 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:36.242895 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:36.242895 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:36.242895 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:36.242895 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:36.243330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:36.243953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:36.292556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:36.293052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:36.310495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:36.310495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:36.310877 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:36.311363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:36.312028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:36.312623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:36.705882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:36.714226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b6bd6b98-fff7-4360-8f55-7a38b459da42 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.425976 Oct 10 12:12:36.720567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 257/559] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:36 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:36.757384 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:36.772073 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-15156f7a-a281-426d-aea6-bc5cd02250c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.560153 Oct 10 12:12:36.773046 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 303/560] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:36 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:37.203883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:37.205563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:37.216400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.233047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.233047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:37.233047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.233047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.233842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:37.266815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:37.268999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:37.284240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.285284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.286112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:37.287236 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.287965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.288947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:37.587087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:37.598889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1894f1e3-a103-4314-ba78-cd26a1a6d518 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.400418 Oct 10 12:12:37.600058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 258/561] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:37 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:37.606618 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:37.616254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:37.617784 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:37.619417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-913bcd6c-df23-4717-960a-6d3ce3731e69 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.358118 Oct 10 12:12:37.635106 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 304/562] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:37 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:37.754057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:37.754570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:37.760756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.761241 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.761676 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:37.762412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.762906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.763331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:37.820542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:37.821804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:37.833222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.834111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.834916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:37.836152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:37.836991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:37.837787 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:38.063660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:38.082785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-77bc7b1c-f5e7-44f4-be85-800f677b965e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.332891 Oct 10 12:12:38.083747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 259/563] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:37 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:38.413979 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:38.420703 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d153fa7c-2517-4e33-b91a-8d0a48247860 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.624107 Oct 10 12:12:38.421642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 305/564] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:37 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:38.623499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:38.624776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:38.631780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:38.632518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:38.633130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:38.634001 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:38.634630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:38.635293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:38.646613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:38.647265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:38.662507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:38.663077 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:38.663521 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:38.664245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:38.664706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:38.665138 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:38.979764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:38.989816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:38.994301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:38.996451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:39.002488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-80f1d07f-2ed9-4b08-86cd-072fbe065ef0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.355265 Oct 10 12:12:39.002488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 306/565] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:38 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:39.004966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-80543d2e-646b-4f68-85cf-45c4f02a7064 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.385366 Oct 10 12:12:39.022929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 260/566] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:38 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:39.116001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:39.116812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:39.123761 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:39.124327 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:39.124871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:39.126180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:39.126744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:39.127247 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:39.330189 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:39.341699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ad879845-5cea-48a6-aee7-d6cb5a4f0316 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.231333 Oct 10 12:12:39.343024 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 307/567] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:39 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:39.452234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:39.454235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:39.466639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:39.467463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:39.468072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:39.469147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:39.469852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:39.470972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:39.716485 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:39.733327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-33983e3d-6f87-4567-b6cf-420a1689ee35 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.289362 Oct 10 12:12:39.734413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 261/568] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:39 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:40.029824 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:40.030615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:40.036630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:40.037329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:40.038573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.039243 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.039707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.040559 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.041113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.041819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.044850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.045340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.045780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.047763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.048351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.048989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.257817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:40.271393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:40.280910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4ea2aa53-72fd-4ffd-bb0b-feaa03927a2b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.254854 Oct 10 12:12:40.283661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 308/569] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:40 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:40.285175 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:40.287554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:40.289727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2872a764-2334-40e7-ab83-58f6766591dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.256835 Oct 10 12:12:40.301517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 262/570] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:40 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:40.379058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:40.380141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:40.387163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.387753 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.388266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.389095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.389614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.390428 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.571772 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:40.581587 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8de87dc9-833c-4e3f-9153-dcb77c877d12 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.209747 Oct 10 12:12:40.582173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 309/571] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:40 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:40.760999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:40.761700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:40.768666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.769477 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.770155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.770972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:40.771768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:40.772206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:40.928096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:40.936831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ea138631-bde4-4716-aff1-3b75da7f359d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.179821 Oct 10 12:12:40.937433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 263/572] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:40 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:41.304394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:41.305007 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:41.311778 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.312266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.313839 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:41.314571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.315053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.315484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:41.333364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:41.334127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:41.340162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.340641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.341068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:41.341755 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.342203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.342623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:41.519673 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:41.523994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:41.527556 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d3ab6b20-5b3f-4639-ae46-09521c3f849a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.226966 Oct 10 12:12:41.528172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 310/573] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:41 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:41.532648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:41.534134 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:41.535426 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-213ca6e2-3b76-421f-a02c-6e5caea7effb tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.205877 Oct 10 12:12:41.535870 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 264/574] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:41 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:41.606047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:41.606680 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:41.613311 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.613796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.614235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:41.614962 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.615412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.615838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:41.756966 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:41.765799 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0d87e419-02e3-4e2b-ac2b-d05530830c41 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.163745 Oct 10 12:12:41.766340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 311/575] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:41 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:41.960022 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:41.960666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:41.968876 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.969882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.970458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:41.971026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:41.971618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:41.971926 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:42.134469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:42.143756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f2e6c902-24e4-4498-b6e7-6c86536aa3dd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.187616 Oct 10 12:12:42.148659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 265/576] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:41 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:42.550106 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:42.550738 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:42.557796 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:42.558390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:42.558931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:42.559702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:42.560166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:42.560592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:42.560919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:42.561569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:42.568246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:42.568984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:42.569421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:42.570114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:42.570568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:42.571030 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:42.778994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:42.787315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:42.787880 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-91f400a8-f181-4710-b9f0-eeb455f628bd tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.241838 Oct 10 12:12:42.788357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 312/577] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:42 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:42.793035 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:42.793645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:42.796192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:42.798571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:42.799991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3d76fd27-bfcc-4345-af1e-fbd065c0a360 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.242932 Oct 10 12:12:42.800143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:42.800560 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:42.800841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 266/578] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:42 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:42.801042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:42.801693 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:42.802151 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:42.802583 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:42.932414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:42.941212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-daf144b5-3123-446d-a5b9-2cf1a9ba3b14 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.151754 Oct 10 12:12:42.941786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 313/579] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:42 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:43.168466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:43.169083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:43.175621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:43.176109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:43.176550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:43.177232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:43.177686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:43.178113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:43.310021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:43.319081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f7ae66f0-84f5-4862-8954-44dfc84e16c6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.154367 Oct 10 12:12:43.319660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 267/580] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:43 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:43.810597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:43.816634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:43.818561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:43.819251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:43.819692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:43.820495 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:43.820959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:43.821447 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:43.825485 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:43.826097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:43.832375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:43.832867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:43.833301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:43.834003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:43.834453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:43.834915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:44.025351 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:44.033531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6ab2f492-6a8b-4827-b6cd-37c5ad2f2b39 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.226787 Oct 10 12:12:44.034118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 314/581] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:43 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:44.037459 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:44.040949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:44.042373 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:44.047579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:44.049130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:44.049403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:44.049892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:44.050328 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:44.050481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0f954523-aeaa-4671-91bc-4de6d0b649f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.228899 Oct 10 12:12:44.051059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:44.051166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 268/582] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:43 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:44.051559 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:44.051984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:44.185978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:44.194723 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-aa4c2187-1445-46f6-a4bc-e9d588a5409b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.159309 Oct 10 12:12:44.195297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 315/583] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:44 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:44.342894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:44.343539 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:44.350917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:44.351401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:44.351841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:44.352527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:44.352983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:44.353407 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:44.357375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:44.501436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:44.505921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-91324fe8-5a2a-4531-8729-69c36834f6b5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.167129 Oct 10 12:12:44.506492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 269/584] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:44 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:45.056374 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:45.056995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:45.064288 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.064768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.065280 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.065976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.066419 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.066883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.079790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:45.080401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:45.087968 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.088569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.089166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.090035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.090623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.091117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.276065 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:45.284360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-254bea50-5eac-485b-829d-6dcdea1c39be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.231912 Oct 10 12:12:45.284933 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 316/585] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:45 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:45.289499 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:45.290252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:45.291468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:45.296372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.296857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.297812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.298534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.299012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.299435 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.300572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:45.302018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:45.303311 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-04288aa6-2f61-4cc6-b6b9-717cfa0dd9dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.228237 Oct 10 12:12:45.303878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 270/586] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:45 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:45.428536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:45.436191 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-28657eea-fcb7-4567-acdb-73281f7c5f4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.150325 Oct 10 12:12:45.436768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 317/587] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:45 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:45.529096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:45.529708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:45.536461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.536961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.537437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.538139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:45.538596 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:45.539087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:45.670259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:45.679125 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-19510b4a-1e5b-413a-9371-b621b886188f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.153933 Oct 10 12:12:45.679736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 271/588] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:45 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:46.307846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:46.308459 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:46.315412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.315882 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.316308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.317001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.317447 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.317863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.330879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:46.334596 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:46.343266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.345852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.346923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.348497 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.349588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.350055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.543962 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:46.548169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:46.552013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fb13b982-a9e1-4197-8dd1-6e8f4c0ca89a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.248043 Oct 10 12:12:46.552847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 318/589] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:46 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:46.557015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:46.557616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:46.558158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:46.559638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:46.560823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fe3c8f78-c9bc-4eaa-8253-99eb362f4aef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.235061 Oct 10 12:12:46.561600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 272/590] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:46 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:46.563889 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.564418 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.564786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.565470 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.565923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.566345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.584734 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:46.704417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:46.705033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:46.706138 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:46.714933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.714933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.714933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.714933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:46.715300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:46.715300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:46.715922 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4eaff096-f48b-43b5-a7cc-741bde012016 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.162040 Oct 10 12:12:46.716738 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 319/591] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:46 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:46.841763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:46.850440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-81f882cc-d1c0-4ebd-ae8d-bfb36cfdbfa7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.150410 Oct 10 12:12:46.851033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 273/592] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:46 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:47.575412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:47.576019 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:47.583172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.583654 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.584091 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.584774 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.585222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.585711 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.586947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:47.587554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:47.593723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.594961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.595402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.596095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.596544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.596969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.785723 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:47.790108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:47.793516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f93eb7e8-1ff8-4ae8-9c26-0552fb83705a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.221914 Oct 10 12:12:47.794090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 320/593] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:47 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:47.802248 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:47.802369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:47.802483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:47.802583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:47.802583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5ea4b177-379d-4e97-940e-90a5a0d64766 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.218244 Oct 10 12:12:47.802583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 274/594] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:47 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:47.806541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.807165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.807696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.808503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.809033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.809456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.873413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:47.874021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:47.880035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.880514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.880942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.881627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:47.882072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:47.882488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:47.970786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:47.978945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cbb1a0f0-48bf-4b49-9cc5-a66a92cc2e8a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.183760 Oct 10 12:12:47.979618 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 321/595] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:47 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:48.036882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:48.045094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a12dd859-797c-4e71-8613-43df699998e3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.175516 Oct 10 12:12:48.045667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 275/596] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:47 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:48.816645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:48.817258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:48.823694 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:48.824181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:48.824617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:48.825315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:48.825771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:48.826197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:48.827962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:48.828642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:48.834881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:48.835361 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:48.835797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:48.836477 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:48.836923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:48.837342 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:49.019570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:49.028119 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3f4d2a31-567f-4842-927a-a936655c5862 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.215074 Oct 10 12:12:49.028534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 322/597] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:48 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:49.030421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:49.033595 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:49.034202 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:49.039960 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:49.040091 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:49.040445 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:49.040883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:49.041467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:49.041586 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:49.042017 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:49.042443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:49.042628 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2ff254fd-76da-4710-81e6-e515c9e35ca0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.218618 Oct 10 12:12:49.043491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 276/598] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:48 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:49.067715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:49.068384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:49.074250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:49.074770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:49.075205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:49.075894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:49.076346 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:49.076768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:49.242370 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:49.249433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:49.251129 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c54a9a5c-47f0-4928-abbe-b7eb288dc85e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.221470 Oct 10 12:12:49.251720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 323/599] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:49 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:49.257950 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b87155e0-ae3b-4ba2-9907-6f85ef64a82c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.193832 Oct 10 12:12:49.258631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 277/600] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:49 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:50.051429 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:50.052078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:50.058505 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.059027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.059491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.060158 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.060617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.061048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.069571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:50.075540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:50.076481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.076964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.077406 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.078090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.078541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.079547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.260810 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:50.268358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:50.269732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-59a04be8-88c0-45cb-ba75-5465e2ec202b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.222735 Oct 10 12:12:50.270403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 324/601] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:50 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:50.276232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:50.276232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:50.277366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:50.278865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:50.280193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a06a30ec-2626-431e-b121-b3cea07ab569 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.214964 Oct 10 12:12:50.280972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 278/602] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:50 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:50.282459 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.286920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.286920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.286920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.286920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.287322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.287410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:50.287410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:50.291915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.292456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.292899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.293598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:50.294061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:50.294492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:50.478409 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:50.487259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-06145f29-e390-42a6-8e9a-8a5e53174545 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.215747 Oct 10 12:12:50.487858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 325/603] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:50 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:50.490870 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:50.499148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d8ad7a66-faee-406d-9553-11bc840f7db0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.217403 Oct 10 12:12:50.499786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 279/604] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:50 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:50.945677 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-667712186", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "networks": [{"uuid": "81f47188-f87d-4346-bd72-870978ce64be"}]}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:51.006266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] validate_networks() for [('81f47188-f87d-4346-bd72-870978ce64be', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:12:51.119771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-6516abee-76d2-414c-ae1b-0442f93c2788 req-f9f03fe1-8399-4756-8c05-f6c03d919fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f92846d-2cb9-4e32-ae7a-a5a7d775bc36", "name": "network-vif-plugged", "status": "completed", "tag": "25362498-cffe-413c-a09b-5810fd5593c4"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:51.130654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6516abee-76d2-414c-ae1b-0442f93c2788 req-f9f03fe1-8399-4756-8c05-f6c03d919fee service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.131169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6516abee-76d2-414c-ae1b-0442f93c2788 req-f9f03fe1-8399-4756-8c05-f6c03d919fee service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.131608 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6516abee-76d2-414c-ae1b-0442f93c2788 req-f9f03fe1-8399-4756-8c05-f6c03d919fee service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.143437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-6516abee-76d2-414c-ae1b-0442f93c2788 req-f9f03fe1-8399-4756-8c05-f6c03d919fee service nova] Creating event network-vif-plugged:25362498-cffe-413c-a09b-5810fd5593c4 for instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 on hv-cinder-86020 Oct 10 12:12:51.148491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-6516abee-76d2-414c-ae1b-0442f93c2788 req-f9f03fe1-8399-4756-8c05-f6c03d919fee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Oct 10 12:12:51.149308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 280/605] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:12:51.294696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:51.295545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:51.303916 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.304435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.304948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.305905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.306567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.307102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.445374 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Flavor limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:12:51.446366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Image limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:12:51.446892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Flavor pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:12:51.448053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Image pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:12:51.448488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:12:51.459419 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.459909 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.466337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.467563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.468378 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.468994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.492098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:51.500141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Getting quotas for project 42363f6f6a6040e5b81070350a2b7855. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:12:51.500331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5479c5f6-8c79-463b-9e07-17eb5502002b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.209807 Oct 10 12:12:51.500950 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 281/606] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:51 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:51.504921 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Getting quotas for user 13ac3580c0164d20994d68744d9153b8 and project 42363f6f6a6040e5b81070350a2b7855. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:12:51.506359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:51.507176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:51.513903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.514623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.515246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.518305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.518887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.519388 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Going to run 1 instances... {{(pid=121298) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:12:51.519807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.521271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:12:51.667718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:51.680127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:51.681837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:51.683856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1a30f837-3439-4e4f-bd8f-67ccce5872b7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.181421 Oct 10 12:12:51.684418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 282/607] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:51 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:51.692274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:51.692878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:51.697448 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-eb7c3f3f-a45f-45fa-93cb-c784e5641a4f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755483 Oct 10 12:12:51.699225 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 326/608] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:12:51.705048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:51.705894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:51.713374 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.714072 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.714660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.715647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.716660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.717668 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.718994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.719518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.721732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.722441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:51.723173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:51.727093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:51.966286 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:51.971195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:51.977844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2cb33cd0-3908-458a-bd17-456a3629ca6e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.275546 Oct 10 12:12:51.977844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 327/609] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:51 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:51.980939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-866b1efe-1561-4d6f-aa5f-ea3b04de9739 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.295419 Oct 10 12:12:51.981525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 283/610] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:51 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:51.984551 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7aed5047-2128-4282-928a-0d9e1d050f78 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:51.985172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7aed5047-2128-4282-928a-0d9e1d050f78 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:52.038888 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7aed5047-2128-4282-928a-0d9e1d050f78 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:52.046175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7aed5047-2128-4282-928a-0d9e1d050f78 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1218 microversion: 2.1 time: 0.068585 Oct 10 12:12:52.046873 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 328/611] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:51 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:52.524784 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:52.525649 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:52.534152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:52.535040 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:52.535725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:52.537075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:52.538488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:52.539215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:52.682236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:52.691042 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3d5e8854-d0fc-4030-8977-0f609e0cd1be tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.171409 Oct 10 12:12:52.691609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 284/612] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:52 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:52.762476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:52.763116 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:52.770294 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:52.770807 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:52.771960 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:52.771960 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:52.772616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:52.773048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:52.917371 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:52.926295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:52.927699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:52.928920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-edf405e8-21c3-4fbd-8fd8-901d18a5905c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1741 microversion: 2.20 time: 0.170499 Oct 10 12:12:52.933001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 329/613] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:52 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:52.999719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:53.005861 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:53.006483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:53.009857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:53.013644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.014233 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.014783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.015570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.016097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.016197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.016659 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.016759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.017137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.017967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.018420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.018870 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.226535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:53.233327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:53.234492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c5c09230-2901-4e9a-baac-cb4a9ff85f92 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.232418 Oct 10 12:12:53.235266 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 330/614] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:53 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:53.242088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:53.253383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:53.253541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-811921e3-7191-4baa-a118-d117deb1b5e9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1719 microversion: 2.1 time: 0.250621 Oct 10 12:12:53.253541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 285/615] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:52 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1719 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:53.253709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.253709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.253709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.253709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.254033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.254033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.313462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:53.321565 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6eae1e6e-688a-45ef-ad25-4a7d170ded36 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1222 microversion: 2.1 time: 0.084563 Oct 10 12:12:53.322139 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 331/616] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:53 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:53.714961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:53.715586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:53.722809 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.723314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.723757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.724465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.724922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.725348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.745293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:53.871890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:53.881026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e95290aa-8661-4ec8-aa0a-da7453fdeb9c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.170279 Oct 10 12:12:53.895111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 286/617] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:53 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:53.956373 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:53.957598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:53.964521 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.965011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.965450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:53.966187 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:53.966639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:53.967110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.112452 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:54.120807 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:54.122239 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:54.123416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6e8bfd1c-f933-437c-807c-28fc1b846c0c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1723 microversion: 2.20 time: 0.172285 Oct 10 12:12:54.123965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 332/618] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:53 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:54.259799 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:54.260339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:54.266539 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.267611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.268084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.268777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.269243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.269808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.274150 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:54.274792 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:54.280804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.281290 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.281715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.282410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.282936 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.283355 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.467388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:54.474969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:54.477627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8ad9dc0c-1d65-4a2f-988c-e3a0c4863313 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.221729 Oct 10 12:12:54.478253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 287/619] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:54 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:54.483431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:54.484319 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:54.486216 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-adba495b-f45c-40e3-b4aa-7a5dceb5bc3b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1696 microversion: 2.1 time: 0.215343 Oct 10 12:12:54.488400 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 333/620] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:54 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:54.494251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.494251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.494251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.494251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.494598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.494598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.515693 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7fffad81-f1a2-48dd-af29-911b7356a97f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:54.521876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7fffad81-f1a2-48dd-af29-911b7356a97f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.529008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7fffad81-f1a2-48dd-af29-911b7356a97f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.529008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7fffad81-f1a2-48dd-af29-911b7356a97f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.545795 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7fffad81-f1a2-48dd-af29-911b7356a97f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Going to try to start instance {{(pid=121298) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 12:12:54.556964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:54.566016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-37e1b106-eed6-4e3b-a97a-c9846113d422 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1270 microversion: 2.1 time: 0.086736 Oct 10 12:12:54.566751 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 288/621] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:54 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:54.778173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7fffad81-f1a2-48dd-af29-911b7356a97f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action" status: 202 len: 0 microversion: 2.1 time: 0.266198 Oct 10 12:12:54.778743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 334/622] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:12:54 2022] POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:12:54.787914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:54.792666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:54.796022 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.796535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.796977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.797685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.798720 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.799155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.912286 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:54.914753 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:54.919621 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.919621 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.919621 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.921394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:54.922023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:54.922399 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:54.970549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:54.984295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4d258606-7446-410d-8322-0ed823a13a7e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1705 microversion: 2.1 time: 0.199850 Oct 10 12:12:54.988112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 289/623] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:54 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1705 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:55.098200 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:55.106082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-13c9313e-b10a-419d-920d-16b1f4a73ad5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.204551 Oct 10 12:12:55.106652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 335/624] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:54 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:55.150000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:55.150733 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:55.160699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:55.160699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:55.160699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:55.160699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:55.161076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:55.161076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:55.166066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-8ae9c68c-532e-4d1e-bd39-29a1f614e1fd req-c877e66f-4a4e-4f1e-a2c2-ac6e4c35e8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51573a-beab-4197-840e-a9427a52e273", "name": "network-vif-unplugged", "status": "completed", "tag": "98e81f6a-0ff4-4344-ab00-e77663d7f2cf"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:55.176413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-8ae9c68c-532e-4d1e-bd39-29a1f614e1fd req-c877e66f-4a4e-4f1e-a2c2-ac6e4c35e8de service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:55.177058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-8ae9c68c-532e-4d1e-bd39-29a1f614e1fd req-c877e66f-4a4e-4f1e-a2c2-ac6e4c35e8de service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:55.177674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-8ae9c68c-532e-4d1e-bd39-29a1f614e1fd req-c877e66f-4a4e-4f1e-a2c2-ac6e4c35e8de service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:55.200536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-8ae9c68c-532e-4d1e-bd39-29a1f614e1fd req-c877e66f-4a4e-4f1e-a2c2-ac6e4c35e8de service nova] Creating event network-vif-unplugged:98e81f6a-0ff4-4344-ab00-e77663d7f2cf for instance 3e51573a-beab-4197-840e-a9427a52e273 on hv-cinder-86020 Oct 10 12:12:55.206765 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-8ae9c68c-532e-4d1e-bd39-29a1f614e1fd req-c877e66f-4a4e-4f1e-a2c2-ac6e4c35e8de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044525 Oct 10 12:12:55.207469 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 336/625] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:12:55.308521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:55.317382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:55.318963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:55.320324 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-314ddc37-10d6-48fc-bb11-e240df072cbe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1723 microversion: 2.20 time: 0.174279 Oct 10 12:12:55.321093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 290/626] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:55 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:55.505317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:55.506044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:55.514188 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:55.514493 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:55.514965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:55.515815 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:55.516279 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:55.517308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:55.553166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:55.598167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:55.599130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:55.606364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:55.607112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:55.608449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:55.609315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:55.609920 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:55.610526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:55.703484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:55.713938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0d130b96-e35b-4cf7-800c-a1c4d9769c6a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1270 microversion: 2.1 time: 0.123389 Oct 10 12:12:55.714144 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:55.714737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 291/627] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:55 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:55.724230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-88056df0-eacd-4bae-966c-fd61acecc69b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.225255 Oct 10 12:12:55.725675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 337/628] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:55 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:56.021902 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:56.022511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:56.031059 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.031558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.031994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.032717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.033176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.033814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.129724 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:56.130540 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:56.137836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.138333 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.138811 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.139510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.139986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.140559 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.194044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:56.203138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8f46eb95-292a-46e7-9a5e-ee1fd65a4e2b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1705 microversion: 2.1 time: 0.185374 Oct 10 12:12:56.204610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 292/629] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:56 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1705 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:56.290682 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:56.296912 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8f850087-8434-455f-8970-5ed31ca423fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1264 microversion: 2.1 time: 0.171994 Oct 10 12:12:56.297503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 338/630] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:56 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:56.348281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:56.348967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:56.355145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.355650 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.356065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.356753 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.357203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.357627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.489758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:56.497997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:56.499471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:56.500644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a3ff9342-589d-4c6a-9fe9-bc6211108166 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1723 microversion: 2.20 time: 0.157385 Oct 10 12:12:56.501571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 293/631] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:56 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:56.737382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:56.737993 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:56.739983 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:56.745372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.752289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.752289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.752289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.752289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.753172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.822082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:56.830893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8691e6c2-b3cb-422e-a1c5-33183dac6849 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1270 microversion: 2.1 time: 0.096825 Oct 10 12:12:56.831670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 339/632] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:56 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:56.983249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:56.983915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:56.990182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.990601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.991187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:56.991938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:56.992390 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:56.992816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.123953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:57.132254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d9285be1-2945-44c3-939e-b3299da79353 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.386631 Oct 10 12:12:57.132886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 294/633] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:56 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:57.236157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:57.237416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:57.244095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.244511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.245001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.245724 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.246287 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.246771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.321940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:57.322555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:57.329827 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.335335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.335335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.335335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.335335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.335707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.410001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:57.418471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c6c0917e-379d-4c5e-8124-f9381e169f06 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1705 microversion: 2.1 time: 0.186315 Oct 10 12:12:57.419169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 340/634] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:57 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1705 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:57.484118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:57.492648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3c2f97b9-c3b7-4c7e-bd4b-3506338f1e9a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1452 microversion: 2.1 time: 0.174485 Oct 10 12:12:57.493432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 295/635] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:57 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:57.516255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:57.516871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:57.523208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.523694 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.527869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.527869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.527869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.527869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.528181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:57.528181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:57.532678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.533160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.533588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.534322 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.534797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.535217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.962685 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:57.968154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:57.976021 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e5d38355-0477-4ca1-8851-e0b0e096e6fb tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1452 microversion: 2.1 time: 0.463570 Oct 10 12:12:57.994534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 341/636] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:57 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1452 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:57.995183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:57.995183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:57.995183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-73c80948-a7d1-45cc-b65f-d8dcd16c43f1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1723 microversion: 2.20 time: 0.459284 Oct 10 12:12:57.995895 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-5ca9b93f-92d8-4013-9a19-696cb98a1db5 req-f3468ab3-e5c3-4b41-8561-ca4c9bdac9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3", "name": "network-vif-plugged", "status": "completed", "tag": "0ced9ae0-41b3-43d6-830e-32265066d50b"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:57.996007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 296/637] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:57 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:12:57.996007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:57.996007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:57.996007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.996321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.996678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:57.997371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:57.997879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:57.998249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:58.007004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-5ca9b93f-92d8-4013-9a19-696cb98a1db5 req-f3468ab3-e5c3-4b41-8561-ca4c9bdac9c1 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:58.007490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-5ca9b93f-92d8-4013-9a19-696cb98a1db5 req-f3468ab3-e5c3-4b41-8561-ca4c9bdac9c1 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:58.007924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-5ca9b93f-92d8-4013-9a19-696cb98a1db5 req-f3468ab3-e5c3-4b41-8561-ca4c9bdac9c1 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:58.019920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-5ca9b93f-92d8-4013-9a19-696cb98a1db5 req-f3468ab3-e5c3-4b41-8561-ca4c9bdac9c1 service nova] Creating event network-vif-plugged:0ced9ae0-41b3-43d6-830e-32265066d50b for instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 on hv-cinder-86020 Oct 10 12:12:58.025364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-5ca9b93f-92d8-4013-9a19-696cb98a1db5 req-f3468ab3-e5c3-4b41-8561-ca4c9bdac9c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046985 Oct 10 12:12:58.026264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 342/638] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:12:58.081484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:58.089571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-19b67461-fbec-484b-b41e-67acbbb91853 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1270 microversion: 2.1 time: 0.105921 Oct 10 12:12:58.090189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 297/639] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:57 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:58.163618 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:58.164450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:58.172966 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:58.173463 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:58.174591 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:58.175379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:58.175886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:58.184516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:58.316830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:58.325017 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-92c99382-48b2-4f17-82e7-788c162ed915 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.166671 Oct 10 12:12:58.327657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 343/640] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:58 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:58.442993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:58.443614 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:58.445483 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:58.450462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:58.451000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:58.451445 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:58.452268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:58.452719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:58.453151 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:58.620802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:58.636807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c92f436b-f86d-4a40-aa58-704402b2c1d4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1705 microversion: 2.1 time: 0.195929 Oct 10 12:12:58.637486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 298/641] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:58 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1705 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:12:59.011920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:59.012532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:59.019433 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.019925 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.020360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.021195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.021736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.022444 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.117809 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:59.120208 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:59.142844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.144092 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.144917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.145858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.148021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.149742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.291964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:59.295974 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:59.300402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-61d49b01-be6c-441f-b85c-b284b68b8adb tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1278 microversion: 2.1 time: 0.190712 Oct 10 12:12:59.301698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 299/642] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:59 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:59.306074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:59.307524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:59.308692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c884c0f6-dc4c-49a3-a907-d4006a7db1ba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1726 microversion: 2.20 time: 0.300839 Oct 10 12:12:59.309435 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 344/643] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:12:59 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1726 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:12:59.334277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03c00883-b7e9-4e23-b3f1-d30a5883f62c"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:12:59.336942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:59.343575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.344080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.344521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.345236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.346229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.346691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.349971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:59.350590 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:59.357523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.358260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.358783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.359484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.360104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.360839 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.520721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:59.530793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8416bf31-6b7f-4188-946f-b33fa0988838 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.186067 Oct 10 12:12:59.531384 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 345/644] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:59 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:12:59.781563 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:12:59.782532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:12:59.791630 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.792264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.792768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.793633 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:12:59.794195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:12:59.795233 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:12:59.938095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:12:59.947066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5232fa93-2d2c-4fc7-bb8d-97a42c5e30f1 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1705 microversion: 2.1 time: 0.289669 Oct 10 12:12:59.947638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 346/645] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:12:59 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1705 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:00.301063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:00.326719 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:00.327679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:00.334747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.335234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.335737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.336607 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.337056 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.337483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.398338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c68a5297-48a2-4d9b-a1e9-78f6897e7907 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.068068 Oct 10 12:13:00.400703 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 300/646] 10.222.0.46 () {62 vars in 1364 bytes} [Mon Oct 10 12:12:59 2022] POST /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments => generated 188 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:13:00.415305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:00.425030 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1c8f603e-19cd-4f01-b114-8fd58772f4a6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1276 microversion: 2.1 time: 0.102072 Oct 10 12:13:00.439134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 347/647] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:00 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:00.547372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:13:00.547962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:00.555559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.555729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:00.556048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.556285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:00.557125 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.557845 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.558304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.558750 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.563514 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.568109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.568109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.568109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.568109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.568547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.606682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121297) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 12:13:00.718582 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:00.727281 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d85d843e-f870-4970-b59d-e5a194b5a3ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.175417 Oct 10 12:13:00.728111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 348/648] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:00 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:00.971516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:00.972265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:00.985145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-701d76ac-9b79-4a9f-8ab5-4bb388922370 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/action" status: 202 len: 0 microversion: 2.20 time: 0.441930 Oct 10 12:13:00.986178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 301/649] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 10 12:13:00 2022] POST /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:13:00.988934 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.990010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.990535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.991401 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:00.993136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:00.993646 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:00.994597 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:00.995242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:01.018212 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:01.019291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:01.020081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:01.021127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:01.032638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:01.036243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:01.146875 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:01.158578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5f7cf59d-8f25-4551-9f5d-979cd33004c7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1705 microversion: 2.1 time: 0.190818 Oct 10 12:13:01.174150 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 349/650] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:00 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1705 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:01.233986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-c7720f80-9b48-4eb3-a398-4ee9796d6077 req-d3dd6c0d-d5e6-4045-bb9d-299de82bbf45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f92846d-2cb9-4e32-ae7a-a5a7d775bc36", "tag": "25362498-cffe-413c-a09b-5810fd5593c4"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:13:01.259460 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-c7720f80-9b48-4eb3-a398-4ee9796d6077 req-d3dd6c0d-d5e6-4045-bb9d-299de82bbf45 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:01.260529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-c7720f80-9b48-4eb3-a398-4ee9796d6077 req-d3dd6c0d-d5e6-4045-bb9d-299de82bbf45 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:01.261143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-c7720f80-9b48-4eb3-a398-4ee9796d6077 req-d3dd6c0d-d5e6-4045-bb9d-299de82bbf45 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:01.285224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-c7720f80-9b48-4eb3-a398-4ee9796d6077 req-d3dd6c0d-d5e6-4045-bb9d-299de82bbf45 service nova] Creating event network-changed:25362498-cffe-413c-a09b-5810fd5593c4 for instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 on hv-cinder-86020 Oct 10 12:13:01.292725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:01.293176 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-c7720f80-9b48-4eb3-a398-4ee9796d6077 req-d3dd6c0d-d5e6-4045-bb9d-299de82bbf45 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062657 Oct 10 12:13:01.294331 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 350/651] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:13:01.313254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:01.315563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:01.317369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-603f40f5-4b49-4f0d-96ff-c121d5e5c0f5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1752 microversion: 2.20 time: 0.326366 Oct 10 12:13:01.318357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 302/652] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:00 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1752 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:01.457734 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:01.459507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:01.467092 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:01.467941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:01.468593 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:01.470949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:01.471730 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:01.472662 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:01.489767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:01.641403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:01.656059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a342fb32-4b97-428a-94ea-143db41e561d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.203336 Oct 10 12:13:01.657099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 351/653] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:01 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:01.751799 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:01.753441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:01.761016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:01.762196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:01.762836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:01.763546 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:01.764080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:01.764517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:02.083610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:02.096930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-edd63668-8ed6-4835-aa9c-f869fdb500fe tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1367 microversion: 2.1 time: 0.349308 Oct 10 12:13:02.111280 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 303/654] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:01 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:02.182080 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:02.182818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:02.186257 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=8 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:02.190755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:02.191333 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:02.192947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:02.192947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:02.193395 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:02.193921 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:02.372759 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:02.383135 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9679ee80-a4e8-4e12-9a7d-c8851aae6b0a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1705 microversion: 2.1 time: 0.205491 Oct 10 12:13:02.383939 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 352/655] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:02 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1705 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:02.528324 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:02.528946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:02.535361 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:02.535853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:02.536295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:02.536999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:02.537454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:02.537877 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:02.681259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:02.682516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:02.690256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:02.690864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:02.693895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:02.696156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:02.696938 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:02.697449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:02.697945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:02.719349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:02.719349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:02.719349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-96266223-61bf-4378-b8b0-6e4c052e143c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1752 microversion: 2.20 time: 0.368025 Oct 10 12:13:02.719622 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 304/656] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:02 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1752 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:02.868272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:02.876776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a3dd6b23-deb8-4373-b74d-31551e303771 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.199665 Oct 10 12:13:02.877875 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 353/657] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:02 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:03.122188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:03.122743 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:03.128861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.129362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.129798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.130473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.130948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.131364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.265485 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:03.273772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-56d08cba-cc2a-4718-b31f-6500cca9467c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1557 microversion: 2.1 time: 0.155534 Oct 10 12:13:03.274348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 305/658] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:03 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:03.297067 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:03.297586 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:03.304045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.304537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.304979 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.305679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.306204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.306659 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.347826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-c502edc7-b4fe-4844-8214-32ad3efbd902 req-5c89c0e1-7034-4b78-b566-c8dcf158d3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5514ea21-a816-41ba-a854-19695d42a7f9", "tag": "cd11316d-9aa8-47f3-adba-a7edaf2d5252"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:13:03.363216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-c502edc7-b4fe-4844-8214-32ad3efbd902 req-5c89c0e1-7034-4b78-b566-c8dcf158d3dd service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.363695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-c502edc7-b4fe-4844-8214-32ad3efbd902 req-5c89c0e1-7034-4b78-b566-c8dcf158d3dd service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.364127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-c502edc7-b4fe-4844-8214-32ad3efbd902 req-5c89c0e1-7034-4b78-b566-c8dcf158d3dd service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.375819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-c502edc7-b4fe-4844-8214-32ad3efbd902 req-5c89c0e1-7034-4b78-b566-c8dcf158d3dd service nova] Creating event network-changed:cd11316d-9aa8-47f3-adba-a7edaf2d5252 for instance 5514ea21-a816-41ba-a854-19695d42a7f9 on hv-cinder-86020 Oct 10 12:13:03.383126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-c502edc7-b4fe-4844-8214-32ad3efbd902 req-5c89c0e1-7034-4b78-b566-c8dcf158d3dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039971 Oct 10 12:13:03.383753 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 306/659] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:13:03.394614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-02536c40-64af-433d-bd43-00c940bce1a4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101477 Oct 10 12:13:03.395332 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 354/660] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:13:03 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:13:03.412266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:03.413010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:03.419697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.420190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.420633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.421336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.421846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.422262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.556688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:03.564964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-915333e3-33b1-4212-a9c0-fd74b814ca2f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1709 microversion: 2.1 time: 0.157933 Oct 10 12:13:03.565540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 307/661] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:03 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:03.737437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:03.737981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:03.744096 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.744577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.745016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.745716 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.746167 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.746595 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.900564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:03.901960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:03.913728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.915627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.916287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.919625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:03.920656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:03.922370 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:03.924958 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:03.930954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:03.936754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:03.938547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:03.940482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-73f4edc7-0c91-44b7-bb8f-01b16bf8c008 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1752 microversion: 2.20 time: 0.207544 Oct 10 12:13:03.949775 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 355/662] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:03 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:04.118984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:04.129843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2f9b1407-035a-416b-97b5-36d8bdc729fa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.233265 Oct 10 12:13:04.130643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 308/663] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:03 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:04.980070 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:04.980697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:04.996453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:04.996453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:04.997566 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:04.999744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:05.000460 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:05.001136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:05.141058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:05.151124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:05.152686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:05.153862 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-68a12948-ab5e-4d63-a994-2caffc5331f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1754 microversion: 2.20 time: 0.180090 Oct 10 12:13:05.156431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 356/664] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:04 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:05.156571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:05.156571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:05.163558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:05.164045 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:05.164678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:05.165395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:05.165848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:05.166425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:05.211258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:13:05.211518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Mon Oct 10 12:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 (ip 10.222.0.46) !!! Oct 10 12:13:05.310882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:05.319211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d1896f19-6214-4156-b024-7de4d2e9497b tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.168959 Oct 10 12:13:05.319868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 309/665] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:05 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:05.399277 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-b2a1ac16-2b57-45ac-9691-9dda08128fda req-6fb53d69-574e-44c6-bbef-19303df95f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3", "tag": "0ced9ae0-41b3-43d6-830e-32265066d50b"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:13:05.409721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b2a1ac16-2b57-45ac-9691-9dda08128fda req-6fb53d69-574e-44c6-bbef-19303df95f6c service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:05.410524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b2a1ac16-2b57-45ac-9691-9dda08128fda req-6fb53d69-574e-44c6-bbef-19303df95f6c service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:05.411196 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-b2a1ac16-2b57-45ac-9691-9dda08128fda req-6fb53d69-574e-44c6-bbef-19303df95f6c service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:05.426806 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-b2a1ac16-2b57-45ac-9691-9dda08128fda req-6fb53d69-574e-44c6-bbef-19303df95f6c service nova] Creating event network-changed:0ced9ae0-41b3-43d6-830e-32265066d50b for instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 on hv-cinder-86020 Oct 10 12:13:05.433764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-b2a1ac16-2b57-45ac-9691-9dda08128fda req-6fb53d69-574e-44c6-bbef-19303df95f6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038754 Oct 10 12:13:05.435038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 357/666] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:13:06.181813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:06.183194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:06.192073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:06.192908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:06.193875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:06.194870 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:06.195522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:06.196170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:06.344207 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:06.344908 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:06.351881 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:06.352372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:06.353318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:06.353487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:06.354117 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:06.354547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:06.365611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:06.378343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:06.379953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:06.381174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d51f4f82-4088-4341-b5c2-c97bf2277994 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1754 microversion: 2.20 time: 0.203730 Oct 10 12:13:06.381737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 310/667] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:06 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:06.494078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:06.502540 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-91dccdd2-f068-467b-b5ac-6c77ed8e2a9f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.162735 Oct 10 12:13:06.503143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 358/668] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:06 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:07.406512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:07.407162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:07.413798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:07.414272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:07.414726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:07.415413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:07.415857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:07.416277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:07.525274 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:07.525883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:07.533557 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:07.534039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:07.535175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:07.535891 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:07.536349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:07.536777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:07.567837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:07.576897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:07.579173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:07.580983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c51c2d1d-9cef-4ddb-be92-9e734a2b9c2a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1754 microversion: 2.20 time: 0.178328 Oct 10 12:13:07.581552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 311/669] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:07 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:07.665981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:07.673795 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-98bf5a8d-b3a9-4c0d-9bcc-778ed04dbd3d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.152317 Oct 10 12:13:07.674464 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 359/670] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:07 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:08.607484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:08.608098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:08.614690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:08.615180 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:08.615620 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:08.616320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:08.616773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:08.617198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:08.697570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:08.698334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:08.707793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:08.708568 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:08.708696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:08.709345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:08.709795 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:08.710221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:08.762423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:08.772011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:08.773610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:08.775102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f60ee864-7946-46b7-8fe2-f4827544a9f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1754 microversion: 2.20 time: 0.171763 Oct 10 12:13:08.775998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 312/671] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:08 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:08.850850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:08.858526 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2c6b57b4-5ed0-482b-b96d-c94090bb36af tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.165035 Oct 10 12:13:08.859131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 360/672] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:08 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:09.804268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:09.804800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:09.811286 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:09.811791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:09.812252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:09.812954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:09.813410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:09.813842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:09.881165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:09.881812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:09.888327 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:09.888819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:09.889258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:09.890146 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:09.890602 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:09.891057 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:09.990438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:09.999849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:10.001360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:10.002581 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0fc26fc6-e70e-4ee8-80e2-4359d2151b9a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1754 microversion: 2.20 time: 0.203023 Oct 10 12:13:10.003235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 313/673] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:09 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1754 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:10.036783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:10.044580 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cbae4df9-cda3-463d-8d53-3a87994e7df0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.167285 Oct 10 12:13:10.045182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 361/674] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:09 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:11.029011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:11.029590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:11.036068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:11.036538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:11.036965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:11.037643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:11.038085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:11.038501 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:11.068054 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:11.068664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:11.075569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:11.076047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:11.076472 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:11.077180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:11.077613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:11.078029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:11.241236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:11.251265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:11.252753 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:11.253936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-811348dc-f3ee-4d77-9ea3-873ff700d603 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1754 microversion: 2.20 time: 0.228858 Oct 10 12:13:11.254514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 314/675] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:11 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1754 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:11.264840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:11.272831 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-71eda20e-1b93-4d3b-9f73-ee0166a2874e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.209051 Oct 10 12:13:11.273476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 362/676] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:11 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:12.279153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:12.279894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:12.287171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:12.287653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:12.288087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:12.288775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:12.289222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:12.289644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:12.296347 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:12.296978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:12.303717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:12.304210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:12.304632 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:12.305334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:12.305778 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:12.306199 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:12.477446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:12.486988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:12.488423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:12.489673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-90de6a34-3f4c-4f90-a838-5b0733b40bd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.214344 Oct 10 12:13:12.490354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 315/677] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:12 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:12.498959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:12.506839 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d979673d-90c3-4fcf-aff8-d3bdb1cdee56 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.214234 Oct 10 12:13:12.507413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 363/678] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:12 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:13.515031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:13.515643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:13.522921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:13.523404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:13.523841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:13.524556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:13.524990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:13.525417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:13.529342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:13.530443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:13.537392 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:13.538128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:13.538573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:13.539322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:13.539779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:13.540208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:13.741476 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:13.745770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:13.748669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:13.752585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:13.754061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:13.755259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e8eb287a-8042-4db8-a8dd-e0570c5b649c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.244200 Oct 10 12:13:13.756005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 316/679] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:13 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:13.766906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ddee24ab-a591-499f-b807-0ac06261b813 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.234654 Oct 10 12:13:13.766906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 364/680] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:13 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:14.783617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:14.784184 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:14.784820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:14.784947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:14.791902 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:14.792682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:14.793157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:14.793589 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:14.794001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:14.794649 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:14.794951 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:14.795466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:14.796063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:14.796867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:14.798124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:14.798954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:15.013038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:15.015369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:15.020962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6afce04b-311b-4f83-b15f-b2010cf2b5a8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.241146 Oct 10 12:13:15.021533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 317/681] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:14 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:15.024255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:15.025698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:15.026890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c1548b84-59a4-47ca-8f7b-e3415b5154f2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.247083 Oct 10 12:13:15.027447 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 365/682] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:14 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:16.044320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:16.045080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:16.052741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:16.053489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:16.053614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:16.054477 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:16.054908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:16.055966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:16.056708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:16.057307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:16.062376 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:16.063732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:16.064522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:16.065449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:16.066713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:16.067332 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:16.261291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:16.267452 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:16.269580 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fc7721a8-c3e0-473d-a15a-ae25b74c48cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.229081 Oct 10 12:13:16.270373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 318/683] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:16 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:16.278587 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:16.280516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:16.281683 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1fdbae46-dd54-45e7-91a0-a8644b76b2a8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.233175 Oct 10 12:13:16.282237 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 366/684] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:16 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:16.987069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-5444e299-1e74-4259-a28a-757569bfcc6e req-2a5ded14-4c3b-4675-a07e-a87e00d5e122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5514ea21-a816-41ba-a854-19695d42a7f9", "name": "network-vif-plugged", "status": "completed", "tag": "cd11316d-9aa8-47f3-adba-a7edaf2d5252"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:13:16.997100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-5444e299-1e74-4259-a28a-757569bfcc6e req-2a5ded14-4c3b-4675-a07e-a87e00d5e122 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:16.997593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-5444e299-1e74-4259-a28a-757569bfcc6e req-2a5ded14-4c3b-4675-a07e-a87e00d5e122 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:16.998010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-5444e299-1e74-4259-a28a-757569bfcc6e req-2a5ded14-4c3b-4675-a07e-a87e00d5e122 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:17.009314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-5444e299-1e74-4259-a28a-757569bfcc6e req-2a5ded14-4c3b-4675-a07e-a87e00d5e122 service nova] Creating event network-vif-plugged:cd11316d-9aa8-47f3-adba-a7edaf2d5252 for instance 5514ea21-a816-41ba-a854-19695d42a7f9 on hv-cinder-86020 Oct 10 12:13:17.014747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-5444e299-1e74-4259-a28a-757569bfcc6e req-2a5ded14-4c3b-4675-a07e-a87e00d5e122 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031262 Oct 10 12:13:17.015351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 319/685] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:13:17.293074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:17.293650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:17.300110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:17.300629 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:17.301071 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:17.301765 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:17.302314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:17.302817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:17.308431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:17.309117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:17.315164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:17.316123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:17.316588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:17.317278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:17.317720 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:17.318143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:17.510823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:17.514128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:17.518507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-70e6b01f-3dae-4714-a64a-1e32c8741f12 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.229307 Oct 10 12:13:17.519156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 367/686] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:17 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:17.522990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:17.524434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:17.525606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2b8da336-8857-437b-a8f8-cc3c79049875 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.221995 Oct 10 12:13:17.526160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 320/687] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:17 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:18.541498 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:18.542122 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:18.549943 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:18.550437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:18.550908 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:18.551661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:18.551785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:18.552260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:18.552356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:18.552545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:18.558862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:18.559353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:18.559781 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:18.560629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:18.561120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:18.561488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:18.755980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:18.764605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-225201d5-0700-4b6e-a671-e161b1f998b3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.226998 Oct 10 12:13:18.779913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 368/688] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:18 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:18.780392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:18.780392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:18.780594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:18.780594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a63cbc48-37e1-4033-86ea-c84933ade12c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.232697 Oct 10 12:13:18.781654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 321/689] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:18 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:19.790602 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:19.791192 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:19.800681 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:19.801454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:19.802285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:19.803245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:19.804553 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:19.805191 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:19.805302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:19.805830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:19.813732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:19.814228 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:19.814693 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:19.815403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:19.815861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:19.816291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:20.006847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:20.010729 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:20.014886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-22c38030-0273-4afd-8885-c7a24f0eff6d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.228208 Oct 10 12:13:20.015569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 369/690] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:19 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:20.020269 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:20.021691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:20.022895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0d19b2e4-199c-4cd5-bed1-14702def0177 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.221426 Oct 10 12:13:20.023460 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 322/691] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:19 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:21.038584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:21.039225 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:21.046018 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:21.046833 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:21.047271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:21.047967 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:21.048416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:21.048835 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:21.049095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:21.049711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:21.057326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:21.057822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:21.058263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:21.058994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:21.059455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:21.059886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:21.251533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:21.260302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:21.261727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:21.262920 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-da385fcc-c787-476f-a45a-a256ae9de6d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.217744 Oct 10 12:13:21.263490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 323/692] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:21 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:21.267612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:21.276046 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d78e201d-44ad-4571-a6dd-08a52643479d tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.241802 Oct 10 12:13:21.276615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 370/693] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:21 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:22.288945 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:22.289548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:22.296062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:22.296547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:22.296981 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:22.297675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:22.301396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:22.301396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:22.301625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:22.302069 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:22.309243 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:22.309736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:22.310175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:22.310916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:22.311510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:22.312134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:22.515213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:22.519271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:22.524107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:22.525575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:22.526839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d26660b7-15b8-42ec-b540-1bee95e2a6d4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.241720 Oct 10 12:13:22.527011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1135af78-3574-4762-adc4-c8ac1f8855ad tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.231424 Oct 10 12:13:22.527403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 324/694] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:22 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:22.527868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 371/695] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:22 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:23.551027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:23.551629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:23.555146 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:23.555769 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:23.558080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:23.558859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:23.559516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:23.560445 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:23.561103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:23.561776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:23.562940 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:23.563432 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:23.563873 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:23.564569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:23.565194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:23.566362 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:23.768984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:23.772098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:23.777066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8f936002-8fec-4e35-b640-2db45cb0f935 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.230954 Oct 10 12:13:23.777722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 325/696] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:23 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:23.781388 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:23.783078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:23.784319 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fd703513-3ea8-4570-b7f9-ea536f4f711e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.233011 Oct 10 12:13:23.785008 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 372/697] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:23 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:24.800839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:24.801508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:24.808802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:24.809288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:24.809718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:24.809982 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:24.810456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:24.810682 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:24.810862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:24.811522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:24.818147 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:24.818634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:24.819099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:24.831729 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:24.832304 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:24.833438 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:24.838306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:25.001473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:25.025830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:25.026007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0a6b25e9-070d-4a72-b077-74db3bd877e8 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.228811 Oct 10 12:13:25.026735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 326/698] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:24 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:25.034872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:25.036370 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:25.037593 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-22350772-a7ad-401b-bea0-9686fe6921aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.231666 Oct 10 12:13:25.038160 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 373/699] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:24 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:26.048678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:26.049356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:26.056411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:26.056893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:26.057335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:26.058036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:26.058488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:26.058941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:26.063819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:26.064483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:26.071589 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:26.072068 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:26.072496 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:26.073192 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:26.073640 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:26.074058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:26.262119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:26.273104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:26.288090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-159cd79f-7898-45a7-86bb-463a9fea381e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.243193 Oct 10 12:13:26.303318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 327/700] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:26 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:26.303897 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:26.305637 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:26.308069 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0287a097-0ff5-4ae0-b884-e7ffbf0232e5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.246830 Oct 10 12:13:26.308885 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 374/701] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:26 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:27.315731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:27.316353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:27.322900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:27.323382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:27.323821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:27.324506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:27.324959 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:27.325899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:27.333931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:27.334624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:27.336913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=72 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:27.341858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:27.349308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:27.349308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:27.349308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:27.349308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:27.349689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:27.530116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:27.539463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4f8e695f-da48-4237-a70c-3a0c53d0370e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.227467 Oct 10 12:13:27.540059 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 328/702] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:27 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:27.548197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:27.557107 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:27.558525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:27.559738 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1435b3e6-462f-492f-b4e0-118c34346b44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.230314 Oct 10 12:13:27.560295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 375/703] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:27 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:28.562914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:28.563594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:28.566134 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:28.571524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:28.572012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:28.572454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:28.573162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:28.573618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:28.574048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:28.586105 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:28.587693 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:28.593180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:28.593662 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:28.594110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:28.594863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:28.595318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:28.595743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:28.771306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:28.779141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-191a95e8-5054-4188-bea8-9876d0fe6a9a tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.220232 Oct 10 12:13:28.779723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 329/704] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:28 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:28.797042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:28.806731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:28.808165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:28.809325 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-55e1c3cf-3043-4c78-bd66-06a10ab92b2b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.227895 Oct 10 12:13:28.809965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 376/705] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:28 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:29.801460 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:29.802073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:29.809436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:29.809922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:29.810359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:29.811154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:29.811611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:29.812038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:29.837529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:29.838461 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:29.846479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:29.847250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:29.847778 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:29.848472 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:29.849529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:29.849846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:30.228584 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:30.236268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9c975bc3-f8ce-444c-b223-23f9dc9cbefa tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.438736 Oct 10 12:13:30.236844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 330/706] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:29 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:30.245171 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:30.255273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:30.257253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:30.258436 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f99ca115-c741-402e-92e8-c8cfcfb5c47b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.426300 Oct 10 12:13:30.259308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 377/707] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:29 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:31.260336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:31.260917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:31.267402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:31.267879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:31.268310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:31.268990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:31.269435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:31.269854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:31.283937 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:31.285377 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:31.292924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:31.293456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:31.294425 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:31.295367 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:31.296020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:31.296639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:31.466823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:31.486895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-57b97aaa-03ed-4adf-ae19-db7aeecba82c tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.230371 Oct 10 12:13:31.487630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 331/708] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:31 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:31.491524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:31.500597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:31.502383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:31.503697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-388c55de-6a32-4e00-96e9-f91ac3d358a2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.223709 Oct 10 12:13:31.504269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 378/709] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:31 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:32.512173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:32.512790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:32.519219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:32.519711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:32.520150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:32.520848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:32.521303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:32.521735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:32.531054 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:32.532094 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:32.539389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:32.539873 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:32.540307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:32.541277 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:32.541465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:32.543076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:32.721366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:32.725457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:32.729961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1e9c34ed-3593-40ea-8c3f-ff329143ca51 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.221551 Oct 10 12:13:32.730759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 332/710] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:32 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:32.734149 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:32.735692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:32.736858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-89f7e949-36d8-4f03-aef1-5ecda600932c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.212091 Oct 10 12:13:32.737408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 379/711] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:32 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:33.753320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:33.753907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:33.760861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:33.761337 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:33.761771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:33.762453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:33.762560 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:33.763133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:33.763332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:33.763427 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:33.769911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:33.777858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:33.777858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:33.777858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:33.777858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:33.778252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:33.964681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:33.978144 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:33.981710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-56fd2a39-e567-450d-a3ee-e176598313e0 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.232217 Oct 10 12:13:33.982338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 333/712] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:33 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:33.987436 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:33.988974 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:33.990648 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5e90d7df-1a08-4fbe-9286-d35bee2ce74f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.231488 Oct 10 12:13:33.994928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 380/713] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:33 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:35.006683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:35.007505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:35.019378 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:35.020128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:35.024467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:35.024980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:35.029139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:35.029139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:35.029139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:35.029139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:35.029458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:35.029458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:35.029458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:35.029898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:35.030527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:35.030985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:35.031936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:35.229795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:35.233204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:35.238478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-58051dfb-f17d-4966-a962-168d432fd0f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.236907 Oct 10 12:13:35.239108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 334/714] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:35 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:13:35.248313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:35.248313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:35.248313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-973a1776-c907-4bb8-b3d4-c3ad362da1b0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.232222 Oct 10 12:13:35.248606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 381/715] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:35 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:36.261927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:36.262602 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:36.269169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:36.269648 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:36.270087 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:36.270809 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:36.271856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:36.272316 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:36.278440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:36.284322 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:36.285509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:36.285996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:36.286430 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:36.287819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:36.288273 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:36.288708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:36.480470 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:36.484696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:36.488607 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-48b958f5-f2a2-49db-88b4-7b4376f4aa31 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.230803 Oct 10 12:13:36.489186 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 382/716] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:36 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:36.493726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:36.495199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:36.496364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-22584b55-6900-4b46-9aa1-412a9bff674e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.221981 Oct 10 12:13:36.496999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 335/717] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:36 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:37.511949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:37.512558 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:37.519091 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:37.519564 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:37.519996 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:37.520675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:37.521128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:37.521268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:37.521697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:37.521800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:37.528254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:37.528735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:37.529167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:37.529860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:37.530310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:37.530763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:37.718633 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:37.721841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:37.727501 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2da6915b-0399-4c8b-bb9f-572021de24cd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.219309 Oct 10 12:13:37.728081 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 383/718] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:37 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:37.731765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:37.736767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:37.736767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-62418967-bb91-4dea-9788-fb26e16897bc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.217058 Oct 10 12:13:37.736767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 336/719] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:37 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:38.749646 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:38.750265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:38.757184 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:38.757674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:38.758131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:38.758848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:38.759307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:38.759826 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:38.760846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:38.761460 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:38.768123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:38.768607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:38.770437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:38.770437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:38.770437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:38.770749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:38.952115 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:38.956204 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:38.960465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-63522b05-e88c-4178-8766-405312cbecdd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.214645 Oct 10 12:13:38.961169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 384/720] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:38 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:38.965399 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:38.967009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:38.970305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ada1ac5c-6c31-46ca-a1a9-70f5d365b1e6 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.211364 Oct 10 12:13:38.970305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 337/721] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:38 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:39.983981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:39.984611 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:39.991071 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:39.991543 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:39.991978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:39.992663 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:39.993108 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:39.993253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:39.993676 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:39.993893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:40.000498 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:40.001035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:40.001422 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:40.002119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:40.002567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:40.003026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:40.187727 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:40.196854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d7ad3527-10b8-4b80-934f-16dbcd1cacbc tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.216491 Oct 10 12:13:40.197526 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 385/722] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:39 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:40.199020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:40.207948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:40.209361 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:40.211062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b3fd6713-6486-4713-9350-3130b1d22b03 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.221745 Oct 10 12:13:40.211617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 338/723] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:39 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:13:41.222705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:41.223418 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:41.230364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:41.230913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:41.231348 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:41.232264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:41.232673 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:41.233102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:41.237796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:41.238442 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:41.244962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:41.245459 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:41.245879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:41.246602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:41.247057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:41.247476 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:41.435028 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:41.441856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:41.442763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4215e108-d39f-436c-a1de-a006d9c90157 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1318 microversion: 2.1 time: 0.225390 Oct 10 12:13:41.443354 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 386/724] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:41 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:41.451344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:41.452763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:41.453961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-32902460-bb82-4075-993d-64e361404417 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.220365 Oct 10 12:13:41.454559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 339/725] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:41 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:42.467794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:42.468977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:42.480510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:42.481393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:42.482178 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:42.483955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:42.483955 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:42.484737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:42.485825 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:42.486463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:42.493158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:42.493644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:42.494101 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:42.494862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:42.495282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:42.495706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:42.730431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:42.732850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:42.738576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fa9f3b9c-1997-4e7c-b677-10bb09f3dd43 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1507 microversion: 2.1 time: 0.275216 Oct 10 12:13:42.739206 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 387/726] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:13:42 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:13:42.749896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:42.752752 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:42.752752 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b37675c9-b86a-4767-a70f-87362205467c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.270941 Oct 10 12:13:42.753224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 340/727] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:42 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:42.764300 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "060fb464-71e3-4dab-8237-717ef2f81f36", "device": "/dev/sdb"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:13:42.766883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:42.773055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:42.773546 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:42.774534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:42.775456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:42.775941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:42.776371 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:43.449263 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:43.720522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-83e5a690-7f5c-49d2-8e7a-a4be56ad7f7f tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "POST /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959962 Oct 10 12:13:43.721208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 388/728] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:13:42 2022] POST /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9/os-volume_attachments => generated 194 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:13:43.783090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:43.783090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:43.785777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:43.785907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:43.786288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:43.787010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:43.787465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:43.787889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:43.941648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:43.951344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:43.952779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:43.954005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e51d658c-b6d5-4285-83f4-cd6e4ba66e92 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.180324 Oct 10 12:13:43.954573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 341/729] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:43 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:44.981777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:44.982504 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:44.988633 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:44.989104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:44.989532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:44.990209 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:44.990651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:44.991103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:45.126389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:45.135251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:45.136672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:45.137840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a21275f6-c544-4da9-8005-fe4c6c89c34a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.161349 Oct 10 12:13:45.138402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 389/730] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:44 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:46.164087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:46.164689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:46.171602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:46.172075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:46.172534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:46.173217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:46.173665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:46.174083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:46.313440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:46.323433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:46.324966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:46.326137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b51c1fd4-e0a8-45a0-add6-5cd1e0cb9871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.166247 Oct 10 12:13:46.326719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 342/731] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:46 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:47.351715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:47.352324 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:47.358799 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:47.359317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:47.359808 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:47.360449 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:47.360936 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:47.361321 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:47.491936 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:47.501578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:47.503035 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:47.504220 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c98a0935-aaf7-45d5-b960-e9c5e11d1959 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.156471 Oct 10 12:13:47.504758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 390/732] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:47 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:48.529947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:48.530550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:48.537130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:48.537606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:48.538038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:48.538751 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:48.539233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:48.539657 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:48.670561 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:48.679958 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:48.681436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:48.682624 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a31a6c75-7f71-4908-a6f2-1ec6b7155d9d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.156600 Oct 10 12:13:48.683228 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 343/733] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:48 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:49.709014 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:49.709605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:49.717502 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:49.717987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:49.718425 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:49.719159 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:49.719631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:49.720064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:49.849546 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:49.858691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:49.860127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:49.861294 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2593c04e-039a-426b-a9fd-8d1b39b1d8d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.156390 Oct 10 12:13:49.861867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 391/734] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:49 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:50.886938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:50.887673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:50.894025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:50.894569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:50.901638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:50.901638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:50.901638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:50.901638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:51.028936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:51.037456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:51.038918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:51.040077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9cdf8317-964a-4501-91a8-d99eda1b8f89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.157268 Oct 10 12:13:51.041424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 344/735] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:50 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:52.066295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:52.066941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:52.074502 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:52.075015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:52.075457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:52.076160 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:52.076657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:52.077090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:52.210456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:52.219354 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:52.220788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:52.222210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b5cd6d7f-95cc-4e4c-87e2-9e168ab25fe4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.159933 Oct 10 12:13:52.222865 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 392/736] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:52 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:53.249264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:53.249883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:53.256585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:53.257074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:53.257513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:53.258213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:53.258691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:53.259153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:53.396947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:53.406269 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:53.407745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:53.408919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-38140fe3-1dfc-4b99-aca8-dc7b066801a4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.164337 Oct 10 12:13:53.409480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 345/737] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:53 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:54.435299 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:54.436186 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:54.442984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:54.443565 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:54.444006 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:54.444707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:54.445168 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:54.445597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:54.590500 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:54.592662 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:54.594171 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:54.595386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e84cbaba-8ee1-4c03-a432-248781a2e3d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.164656 Oct 10 12:13:54.595953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 393/738] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:54 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:55.461593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-6574745e-5074-40c7-84e6-01a05a434c8c req-af18181f-5bc0-4cf5-9f73-1418f630cd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51573a-beab-4197-840e-a9427a52e273", "name": "network-vif-plugged", "status": "completed", "tag": "98e81f6a-0ff4-4344-ab00-e77663d7f2cf"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:13:55.476561 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6574745e-5074-40c7-84e6-01a05a434c8c req-af18181f-5bc0-4cf5-9f73-1418f630cd46 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:55.477051 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6574745e-5074-40c7-84e6-01a05a434c8c req-af18181f-5bc0-4cf5-9f73-1418f630cd46 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:55.477491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6574745e-5074-40c7-84e6-01a05a434c8c req-af18181f-5bc0-4cf5-9f73-1418f630cd46 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:55.492393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-6574745e-5074-40c7-84e6-01a05a434c8c req-af18181f-5bc0-4cf5-9f73-1418f630cd46 service nova] Creating event network-vif-plugged:98e81f6a-0ff4-4344-ab00-e77663d7f2cf for instance 3e51573a-beab-4197-840e-a9427a52e273 on hv-cinder-86020 Oct 10 12:13:55.498579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-6574745e-5074-40c7-84e6-01a05a434c8c req-af18181f-5bc0-4cf5-9f73-1418f630cd46 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195355 Oct 10 12:13:55.500041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 346/739] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:13:55.622150 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:55.622770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:55.629206 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:55.629681 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:55.630111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:55.630840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:55.631289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:55.631713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:55.767072 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:55.775919 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:55.777363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:55.781090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4de4e10b-d22c-4d00-be44-9816318c75b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.160834 Oct 10 12:13:55.781090 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 394/740] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:55 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:56.804775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:56.805482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:56.812136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:56.812625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:56.813063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:56.813769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:56.814222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:56.814645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:56.964348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:56.974309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:56.975761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:56.976933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e8bbf7db-de5e-4061-a1a0-cefd2d4bec83 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.176982 Oct 10 12:13:56.977490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 347/741] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:56 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:58.002868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:58.003480 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:58.005893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=40 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:58.010629 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:58.011143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:58.011581 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:58.012271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:58.012724 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:58.013151 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:58.150975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:58.160491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:58.161925 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:58.163127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bfde6501-d570-4189-9d52-ca196173b9d2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.164120 Oct 10 12:13:58.163704 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 395/742] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:57 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:13:59.189666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:13:59.190343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:13:59.192844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=38 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:59.198122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:59.205528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:59.205528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:59.205528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:13:59.205528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:13:59.206085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:13:59.351340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:59.361557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:59.363033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:13:59.364226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2ccff2b6-a999-4756-95e2-c248d95bf457 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.178772 Oct 10 12:13:59.364792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 348/743] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:13:59 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:00.390896 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:00.391546 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:00.398100 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:00.398586 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:00.399069 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:00.399772 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:00.400229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:00.400658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:00.535790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:00.544763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:00.546206 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:00.547404 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-272d91d6-4cfe-4198-8ced-2c6d38f7bbba tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.161146 Oct 10 12:14:00.547977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 396/744] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:00 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:01.577713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:01.578982 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:01.592347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:01.593440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:01.594164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:01.595458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:01.596563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:01.597345 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:01.738559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:01.747886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:01.749332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:01.750610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e4028552-e2cd-45bb-b1da-5d1d633f727c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.180826 Oct 10 12:14:01.751414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 349/745] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:01 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:02.777127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:02.777737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:02.784482 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:02.784964 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:02.785406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:02.786109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:02.786562 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:02.787016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:02.924272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:02.933036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:02.934479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:02.935676 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3d19e6d7-379f-4ace-9e6e-c9e139181c1a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.163041 Oct 10 12:14:02.936244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 397/746] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:02 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:03.961162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:03.961773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:03.968539 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:03.969027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:03.969472 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:03.970176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:03.970632 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:03.971353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:04.104143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:04.113386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:04.114835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:04.115982 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-21680dd5-ec3d-4919-9bd9-25b1aa1f090f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.158746 Oct 10 12:14:04.116538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 350/747] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:03 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:05.143126 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:05.143764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:05.150427 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:05.150935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:05.151365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:05.152059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:05.152535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:05.152950 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:05.287264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:05.297284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:05.298871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:05.300094 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-40ab0883-717f-4318-90bc-506a9a841a86 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.161004 Oct 10 12:14:05.300644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 398/748] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:05 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:06.326295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:06.327028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:06.333734 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:06.334226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:06.334692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:06.335443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:06.335896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:06.336398 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:06.339173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=97 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:06.486572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:06.495154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:06.497102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:06.498252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-97fb4d0a-a311-4b8d-a3fe-5e8c92661b51 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.176584 Oct 10 12:14:06.498824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 351/749] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:06 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:07.523726 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:07.524329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:07.531521 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:07.532000 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:07.532442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:07.533128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:07.533571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:07.533990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:07.665963 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:07.681410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:07.684301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:07.686421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a17ae5e5-a202-4799-a3e0-ed757c203efe tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.166227 Oct 10 12:14:07.687313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 399/750] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:07 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:08.712998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:08.713852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:08.720848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:08.721681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:08.722155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:08.722905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:08.723363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:08.723790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:08.872832 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:08.882082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:08.883600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:08.884819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cd39b008-384e-45ad-845f-cfea317ffb7f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.175876 Oct 10 12:14:08.885454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 352/751] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:08 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:09.912177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:09.912802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:09.919717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:09.920206 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:09.920649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:09.921356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:09.921811 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:09.922243 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:10.057199 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:10.066163 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:10.067699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:10.068873 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4b7f1d8f-e4cb-478a-9ecf-98e4d6db37d3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.160845 Oct 10 12:14:10.069471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 400/752] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:09 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:11.094688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:11.095308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:11.102077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:11.102563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:11.103052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:11.103758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:11.104220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:11.104648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:11.243599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:11.252103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:11.253544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:11.254724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d8de90ab-c621-47e2-b1d6-a97b93e30988 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.164009 Oct 10 12:14:11.255284 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 353/753] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:11 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:12.280555 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:12.281227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:12.287757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:12.288232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:12.288666 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:12.289359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:12.289809 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:12.290230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:12.441824 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:12.451049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:12.452503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:12.453695 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7985a841-2628-4346-b606-1420b28b43e1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.177038 Oct 10 12:14:12.454274 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 401/754] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:12 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:13.480315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:13.480931 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:13.488054 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:13.488542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:13.488974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:13.489679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:13.490124 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:13.490551 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:13.620017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:13.629636 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:13.631137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:13.632307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e737fd83-cf93-47d3-b92d-da6c84295aa9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.155941 Oct 10 12:14:13.632869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 354/755] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:13 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:14:14.227484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:14:14.229848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:14.236129 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:14.236603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:14.237033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:14.237718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:14.238157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:14.238576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:14.241025 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:14.614431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-71c79f90-94ed-4fe3-a945-96ba441b4318 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/action" status: 200 len: 28787 microversion: 2.1 time: 0.555116 Oct 10 12:14:14.615172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 402/756] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:14:14 2022] POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/action => generated 28787 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:14:14.657473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:14.658208 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:14.664888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:14.665445 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:14.665863 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:14.666566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:14.667055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:14.667486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:14.804716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:14.815686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:14.817603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:14.818359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c3ed0b7d-4b5d-453f-b27f-8e80288b679f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.165005 Oct 10 12:14:14.819433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 355/757] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:14 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:15.846324 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:15.846961 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:15.854115 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:15.854606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:15.855071 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:15.855763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:15.856221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:15.856650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:15.986190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:15.995272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:15.996707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:15.997861 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-71171601-789c-4895-967c-b1faf8d7fd44 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.156782 Oct 10 12:14:15.999253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 403/758] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:15 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:17.023907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:17.024456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:17.031695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:17.032106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:17.032545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:17.033284 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:17.033731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:17.034328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:17.167868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:17.177494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:17.178976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:17.180161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8fbcd384-ca4a-44ce-ac97-31139eb19d16 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.160411 Oct 10 12:14:17.180736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 356/759] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:17 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:18.206058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:18.206722 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:18.213535 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:18.214027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:18.218848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:18.218848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:18.218848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:18.218848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:18.349881 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:18.358732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:18.360174 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:18.361336 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c6b389cb-f6aa-448e-9226-a7b8a76ea330 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.159246 Oct 10 12:14:18.361905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 404/760] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:18 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:19.387402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:19.388020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:19.395351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:19.395837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:19.396272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:19.396969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:19.397431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:19.397855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:19.543377 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:19.552973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:19.554431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:19.555682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d42d82e3-5ed4-4e06-8ce5-26d2c4d0294f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.172234 Oct 10 12:14:19.556339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 357/761] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:19 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:20.582149 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:20.582790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:20.589171 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:20.589643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:20.590070 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:20.590783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:20.591231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:20.591679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:20.724844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:20.733393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:20.734870 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:20.736034 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ea254f42-0593-4f52-9983-ad9a7fce0c34 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.157772 Oct 10 12:14:20.736591 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 405/762] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:20 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:21.761528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:21.762140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:21.769550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:21.770039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:21.770736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:21.771382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:21.771837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:21.775963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:21.909127 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:21.918227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:21.921990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:21.923237 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2d53c359-bad9-4df3-9294-074c38f2b7ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1810 microversion: 2.20 time: 0.165871 Oct 10 12:14:21.925750 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 358/763] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:21 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:22.949550 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:22.950164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:22.957486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:22.957977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:22.958601 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:22.959229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:22.959645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:22.960074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:23.101867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:23.110980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:23.112450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:23.113622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4c23d1cd-8957-43bd-84de-29b39b6c0978 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1797 microversion: 2.20 time: 0.167969 Oct 10 12:14:23.114194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 406/764] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:14:22 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1797 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:14:24.755155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:24.755790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:24.762272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:24.762814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:24.763255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:24.764008 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:24.764532 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:24.764914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:24.896213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lazy-loading 'services' on Instance uuid 5514ea21-a816-41ba-a854-19695d42a7f9 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:14:25.219259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6a214bb4-2f95-4bd1-94c3-0663416cd4e6 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9/os-volume_attachments/060fb464-71e3-4dab-8237-717ef2f81f36" status: 202 len: 0 microversion: 2.1 time: 0.467771 Oct 10 12:14:25.220119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 359/765] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:14:24 2022] DELETE /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9/os-volume_attachments/060fb464-71e3-4dab-8237-717ef2f81f36 => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:14:27.417954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:27.418503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:27.425356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:27.425844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:27.426284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:27.427016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:27.427507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:27.427931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:27.455004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Going to try to terminate instance {{(pid=121298) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:14:27.751120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-aab87838-4994-4a94-a86e-3f2a3d3477f1 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 204 len: 0 microversion: 2.1 time: 0.336565 Oct 10 12:14:27.751959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 407/766] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:14:27 2022] DELETE /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:14:27.764067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:27.764793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:27.771114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:27.771600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:27.772032 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:27.772719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:27.773166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:27.773583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:27.911107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:27.918959 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6d04db39-06b9-43b0-a7ce-7be81a6d43f7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1513 microversion: 2.1 time: 0.159619 Oct 10 12:14:27.920026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 360/767] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:27 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:14:28.944131 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:28.944830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:28.947195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:28.952537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:28.953136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:28.953573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:28.954261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:28.960282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:28.960282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:29.093522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:29.101486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-931ae993-37a4-4d9f-a2bc-a86a0d58dfcd tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1513 microversion: 2.1 time: 0.161641 Oct 10 12:14:29.102079 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 408/768] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:28 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:14:30.124301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:30.124909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:30.131548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:30.132035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:30.132473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:30.133168 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:30.133622 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:30.134050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:30.264350 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:30.272121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-303c3d61-001f-42fc-9062-69e1ee8098c7 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1513 microversion: 2.1 time: 0.151719 Oct 10 12:14:30.272690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 361/769] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:30 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:14:31.290802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-eef49bbc-6c60-4d55-ab33-e94586e0a5f7 req-0e265447-5732-4257-b584-62cb989add9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5514ea21-a816-41ba-a854-19695d42a7f9", "name": "network-vif-deleted", "tag": "cd11316d-9aa8-47f3-adba-a7edaf2d5252"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:14:31.296285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:31.296905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:31.301207 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-eef49bbc-6c60-4d55-ab33-e94586e0a5f7 req-0e265447-5732-4257-b584-62cb989add9a service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:31.301689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-eef49bbc-6c60-4d55-ab33-e94586e0a5f7 req-0e265447-5732-4257-b584-62cb989add9a service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:31.302132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-eef49bbc-6c60-4d55-ab33-e94586e0a5f7 req-0e265447-5732-4257-b584-62cb989add9a service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:31.303458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:31.303952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:31.304400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:31.308331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:31.308331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:31.308331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:31.313512 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-eef49bbc-6c60-4d55-ab33-e94586e0a5f7 req-0e265447-5732-4257-b584-62cb989add9a service nova] Creating event network-vif-deleted:cd11316d-9aa8-47f3-adba-a7edaf2d5252 for instance 5514ea21-a816-41ba-a854-19695d42a7f9 on hv-cinder-86020 Oct 10 12:14:31.318524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-eef49bbc-6c60-4d55-ab33-e94586e0a5f7 req-0e265447-5732-4257-b584-62cb989add9a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212116 Oct 10 12:14:31.319175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 409/770] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:14:31.373853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:31.381894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1f966694-fc4e-4e58-a72b-969a185f883e tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1303 microversion: 2.1 time: 0.090158 Oct 10 12:14:31.382458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 362/771] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:31 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:14:32.406474 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:32.407339 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:32.414199 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:32.414289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:32.414744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:32.415447 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:32.415943 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:32.416375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:32.449497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:32.449986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:32.450486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:32.451012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lazy-loading 'fault' on Instance uuid 5514ea21-a816-41ba-a854-19695d42a7f9 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:14:32.493455 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ac3580c0164d20994d68744d9153b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42363f6f6a6040e5b81070350a2b7855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:32.501391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-90d4ef63-4365-456a-bc4c-63befedc3dea tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 200 len: 1308 microversion: 2.1 time: 0.099754 Oct 10 12:14:32.501980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 410/772] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:32 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:14:33.526003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:33.526542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] [instance: 5514ea21-a816-41ba-a854-19695d42a7f9] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:33.529145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=30 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:33.534107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:33.534658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:33.535116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:33.535824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:33.536279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:33.536708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:33.550918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] HTTP exception thrown: Instance 5514ea21-a816-41ba-a854-19695d42a7f9 could not be found. Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Request method failure captured: Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 HTTP/1.1 Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAuLE9tPNg3wwRyKWfwo_MNAvDMDZS49By0raDx6qxlnCMQCLw8cqT3Mk7H4QRRl_H0-FUkRV559uzeSol-hcuaPSWhBGeTry6fPOcenVjoIkXpFaM0F28-HjLaQ1Gj9ssjdPZwjXFnmF34xBu86dvAMTQe4hPjM8XjfcDh-1PEw_S8 Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 42363f6f6a6040e5b81070350a2b7855 Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesSnapshotTestJSON-465442707 Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:14:33.552591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/42363f6f6a6040e5b81070350a2b7855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_42363f6f6a6040e5b81070350a2b7855", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42363f6f6a6040e5b81070350a2b7855"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42363f6f6a6040e5b81070350a2b7855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesSnapshotTestJSON-465442707 Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 42363f6f6a6040e5b81070350a2b7855 Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-465442707 Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesSnapshotTestJSON-465442707-project Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 13ac3580c0164d20994d68744d9153b8 Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesSnapshotTestJSON-465442707-project Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 5514ea21-a816-41ba-a854-19695d42a7f9 could not be found. Oct 10 12:14:33.554194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '5514ea21-a816-41ba-a854-19695d42a7f9'} Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5514ea21-a816-41ba-a854-19695d42a7f9 could not be found. Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:14:33.555076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5514ea21-a816-41ba-a854-19695d42a7f9 could not be found. Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5514ea21-a816-41ba-a854-19695d42a7f9 could not be found. Oct 10 12:14:33.556666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:14:33.558189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] Returning 404 to user: Instance 5514ea21-a816-41ba-a854-19695d42a7f9 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:14:33.558189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d31b215f-838d-46e8-be7d-bbfb386ba1d3 tempest-VolumesSnapshotTestJSON-465442707 tempest-VolumesSnapshotTestJSON-465442707-project] 10.222.0.46 "GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9" status: 404 len: 111 microversion: 2.1 time: 0.032043 Oct 10 12:14:33.558189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 363/773] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:33 2022] GET /compute/v2.1/servers/5514ea21-a816-41ba-a854-19695d42a7f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:14:37.566195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1650ed00-e240-4a59-832f-b20c03b6364a"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:14:37.568552 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:37.575217 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:37.575688 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:37.576127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:37.576818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:37.577374 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:37.577749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:39.481789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:14:39.482452 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:14:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments (ip 10.222.0.46) !!! Oct 10 12:14:42.045779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9eece0eb-792e-45b8-b193-6b98ec1cbba6 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.484163 Oct 10 12:14:42.046424 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 411/774] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:14:37 2022] POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments => generated 194 bytes in 4486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:14:54.106447 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:14:54.108782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:54.111321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:54.117605 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:54.121013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:54.121013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:54.121013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:54.121013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:54.121372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:54.144411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'flavor' on Instance uuid 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:14:54.519983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d56c6d45-2c61-4018-859d-ba16ae4dd591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/action" status: 200 len: 32 microversion: 2.1 time: 0.416870 Oct 10 12:14:54.520516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 364/775] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:14:54 2022] POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:14:54.530753 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:54.535987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:54.535987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=9 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:54.535987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:54.540346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:54.540823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:54.541250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:54.541937 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:54.542379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:54.542829 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:54.673598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:54.682818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-107c5b1d-7e8d-4c11-8db1-c454ec141981 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.156295 Oct 10 12:14:54.685962 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 412/776] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:54 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:14:55.706907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:55.710206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:55.714023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:55.714517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:55.714978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:55.715677 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:55.716131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:55.716560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:55.852401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:55.860791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7683fbb2-6e40-450d-b0c9-436413041436 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.159060 Oct 10 12:14:55.861389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 365/777] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:55 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:14:56.884829 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:56.885525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:56.891996 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:56.892484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:56.892934 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:56.893623 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:56.894134 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:56.894620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:57.031894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:57.040165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7d84401b-695b-46fa-8a4b-551f6a941a30 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.159338 Oct 10 12:14:57.044524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 413/778] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:56 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:14:58.067970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:58.068559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:58.076418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:58.076418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:58.076786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:58.077451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:58.082730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:58.082730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:58.219380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:58.228025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-59f775b6-5146-4108-8c2c-2b57686cac3e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.164646 Oct 10 12:14:58.228594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 366/779] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:58 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:14:59.251950 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:14:59.252493 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:14:59.259409 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:59.259880 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:59.260316 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:59.260996 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:14:59.261431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:14:59.261850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:14:59.394710 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:14:59.403064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f4eb70a7-8d3a-4228-9963-9b15402ac591 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.154951 Oct 10 12:14:59.403643 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 414/780] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:14:59 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:00.427355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:00.427972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:00.434391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:00.434927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:00.435366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:00.436070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:00.436606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:00.436955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:00.567269 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:00.575679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a9b389ff-f204-4fb5-903d-cc938485729c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.152825 Oct 10 12:15:00.576263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 367/781] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:00 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:01.599508 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:01.600639 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:01.606993 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:01.607471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:01.607902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:01.608614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:01.609060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:01.609484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:01.743935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:01.752717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f642c1b3-5343-45bb-8165-dd77eae689f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.157065 Oct 10 12:15:01.753367 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 415/782] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:01 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:02.776664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:02.777276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:02.783955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:02.784439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:02.784877 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:02.785570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:02.786022 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:02.786451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:02.919859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:02.928750 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eed668d8-9c76-4f05-8ae7-93a264c29e82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.155550 Oct 10 12:15:02.929333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 368/783] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:02 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:03.952623 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:03.953235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:03.959672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:03.960150 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:03.960588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:03.961306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:03.961766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:03.962193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:04.100733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:04.109414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bdf6b7e1-d9d0-43f2-a117-e95f9e55af7c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.160708 Oct 10 12:15:04.109991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 416/784] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:03 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:05.133829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:05.134434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:05.141249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:05.141724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:05.142154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:05.142873 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:05.143323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:05.143738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:05.279982 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:05.288597 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-af864256-58eb-4e7e-8b7f-ed733771e836 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.159286 Oct 10 12:15:05.289182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 369/785] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:05 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:15:06.313058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:06.313675 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:06.321205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:06.321697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:06.325055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:06.325055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:06.325055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:06.325055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:06.478424 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:06.487452 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cd9470aa-617a-41be-87c9-47ee28377066 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.178524 Oct 10 12:15:06.488046 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 417/786] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:06 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:07.513095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:07.513716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:07.520222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:07.520710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:07.521148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:07.521865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:07.522321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:07.522802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:07.658278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:07.668946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-afeb79fd-2107-4301-a130-17f2863d931b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.159341 Oct 10 12:15:07.669418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 370/787] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:07 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:08.696403 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:08.697011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:08.703571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:08.704049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:08.704481 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:08.705175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:08.705631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:08.706054 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:08.840157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:08.849157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d3af8d0a-d352-4d7f-87d1-6bd15bcc897c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.157130 Oct 10 12:15:08.849798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 418/788] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:08 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:09.873397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:09.873946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:09.880342 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:09.881156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:09.881292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:09.881937 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:09.882385 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:09.882838 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:10.013497 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:10.021863 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eae528ba-09da-4ba4-8136-330d3524ec35 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.152457 Oct 10 12:15:10.022441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 371/789] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:09 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:11.045375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:11.045988 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:11.053095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:11.053589 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:11.054034 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:11.054767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:11.055224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:11.055653 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:11.189990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:11.199108 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0c4aa042-9010-463d-abad-c1649df8edc1 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.157533 Oct 10 12:15:11.199687 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 419/790] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:11 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:12.222999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:12.223595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:12.230934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:12.231429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:12.231868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:12.232628 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:12.233087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:12.233514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:12.384815 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:12.393179 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f76ea7d5-4ec5-474d-b1db-d8c5f50e844f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.174311 Oct 10 12:15:12.393780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 372/791] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:12 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:13.417987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:13.418614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:13.425071 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:13.425808 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:13.425986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:13.426936 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:13.427389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:13.427921 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:13.573536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:13.582743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-19572448-9270-4e0a-b795-a0466ba52b46 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.168770 Oct 10 12:15:13.583342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 420/792] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:13 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:14.607063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:14.607715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:14.614387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:14.614916 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:14.615997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:14.616712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:14.617170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:14.617600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:14.751158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:14.759871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7c0c9cd1-b2ab-4899-9e9c-ae700d752c89 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1734 microversion: 2.1 time: 0.156683 Oct 10 12:15:14.760444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 373/793] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:14 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:15.783461 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:15.784002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:15.790405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:15.790913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:15.791352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:15.792035 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:15.792489 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:15.792913 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:15.930467 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:15.938980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-080782fd-d76a-4f1e-a0b4-e11997844b13 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1714 microversion: 2.1 time: 0.159247 Oct 10 12:15:15.939552 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 421/794] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:15 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:16.051821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:16.052335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:16.059681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:16.060170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:16.061196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:16.061380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:16.061860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:16.062324 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:16.143664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] HTTP exception thrown: Cannot 'detach_volume' instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 while it is in vm_state rescued Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Request method failure captured: Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments/1650ed00-e240-4a59-832f-b20c03b6364a HTTP/1.1 Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAse6dTSTQcasFgmOM7hNbdxasgbqo82IjkVxrYw2tk_rJqyxLGlSAqrgg96TLD1T8o3wQz_qR3TL3WYm3KepTG9jkOgrJiEiPrnb5-27tfxw2QaoRgf1EvzKsW3HwmQK7s9i1NsfM12drhVq6WvVFRVzCRNEMZZ_w3K-YxOc8pn98E Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:15:16.145314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_782c5fd84235487caac5f9a7e18563cb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 45c87aa85b7d45fe8acf6f36a3d2a639 Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:15:16.146929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Cannot 'detach_volume' instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 while it is in vm_state rescued Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'server_id': '6f0f9c51-ab73-4450-8f3e-eb5d492a34d0', 'id': '1650ed00-e240-4a59-832f-b20c03b6364a'} Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:15:16.147808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 while it is in vm_state rescued Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 while it is in vm_state rescued Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:15:16.149304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Returning 409 to user: Cannot 'detach_volume' instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 while it is in vm_state rescued {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:15:16.150631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e4690cfc-eee2-45dc-b146-766db91dea7e tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments/1650ed00-e240-4a59-832f-b20c03b6364a" status: 409 len: 152 microversion: 2.1 time: 0.099056 Oct 10 12:15:16.150631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 374/795] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:15:16 2022] DELETE /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments/1650ed00-e240-4a59-832f-b20c03b6364a => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 12:15:16.155849 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:16.156375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:16.162790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:16.163269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:16.163701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:16.164381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:16.164833 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:16.165258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:16.387658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6d59863e-539c-4690-9ec0-c369ecb94aab tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/action" status: 202 len: 0 microversion: 2.1 time: 0.235044 Oct 10 12:15:16.388468 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 422/796] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:15:16 2022] POST /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:15:16.397550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:16.398197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:16.404832 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:16.405326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:16.405770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:16.406480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:16.406989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:16.407425 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:16.549718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:16.558430 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9856a531-9431-4c5d-b8d6-51feeaa1c8af tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1722 microversion: 2.1 time: 0.165318 Oct 10 12:15:16.559046 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 375/797] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:16 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:17.583136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:17.584017 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:17.592307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:17.592942 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:17.593381 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:17.594161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:17.594916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:17.595369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:17.747428 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:17.755983 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f9043c0a-d32a-4582-8c73-01cdf6e968c7 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1722 microversion: 2.1 time: 0.177192 Oct 10 12:15:17.756568 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 423/798] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:17 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:18.779878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:18.780396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:18.786996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:18.787480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:18.787916 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:18.788604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:18.789061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:18.789491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:18.917520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:18.925771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3585c2cc-ff36-4064-914d-3a2a516b0a5c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1722 microversion: 2.1 time: 0.149870 Oct 10 12:15:18.926336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 376/799] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:18 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:19.950205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:19.950838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:19.957252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:19.957722 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:19.958156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:19.958918 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:19.959365 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:19.959783 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:20.090026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:20.104157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-db0b8b89-4c4c-4a6f-818a-55c0f1290356 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1722 microversion: 2.1 time: 0.157290 Oct 10 12:15:20.104817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 424/800] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:19 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:21.128099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:21.128697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:21.136541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:21.137021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:21.137443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:21.138130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:21.138604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:21.139047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:21.276724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:21.285027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0a0398ba-637a-46bf-84dd-c68259fd913d tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1728 microversion: 2.1 time: 0.160755 Oct 10 12:15:21.285598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 377/801] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:21 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:21.307242 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:21.311002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:21.314315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:21.314834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:21.315269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:21.316037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:21.316487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:21.316926 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:21.398213 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6115abb3-040c-4dbf-bde0-3f2277fd81f9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093987 Oct 10 12:15:21.398988 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 425/802] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:15:21 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:22.950009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-a5a05078-075b-4231-bacb-1adf314243fb req-571cd8c4-0c27-4a5f-bc6a-c9c0c1382faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0f9c51-ab73-4450-8f3e-eb5d492a34d0", "tag": "5d658caa-5deb-4849-8248-3505cf81be8d"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:22.961094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a5a05078-075b-4231-bacb-1adf314243fb req-571cd8c4-0c27-4a5f-bc6a-c9c0c1382faa service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:22.962149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a5a05078-075b-4231-bacb-1adf314243fb req-571cd8c4-0c27-4a5f-bc6a-c9c0c1382faa service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:22.962149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a5a05078-075b-4231-bacb-1adf314243fb req-571cd8c4-0c27-4a5f-bc6a-c9c0c1382faa service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:22.974002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-a5a05078-075b-4231-bacb-1adf314243fb req-571cd8c4-0c27-4a5f-bc6a-c9c0c1382faa service nova] Creating event network-changed:5d658caa-5deb-4849-8248-3505cf81be8d for instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 on hv-cinder-86020 Oct 10 12:15:22.979644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-a5a05078-075b-4231-bacb-1adf314243fb req-571cd8c4-0c27-4a5f-bc6a-c9c0c1382faa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033512 Oct 10 12:15:22.980251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 378/803] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:23.511656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:23.511656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:23.511656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:23.511656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:23.512510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:23.512510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:23.512510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:23.512510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:23.629971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lazy-loading 'services' on Instance uuid 13c0121a-4f1a-4265-9efd-5a969d73bb7e {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:15:23.910109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bb678cd2-b49f-42e4-ae0f-dbb7bde7461b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-volume_attachments/b2f75993-c869-4314-ba00-552f7a90c38e" status: 202 len: 0 microversion: 2.1 time: 0.412805 Oct 10 12:15:23.910738 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 426/804] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:15:23 2022] DELETE /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-volume_attachments/b2f75993-c869-4314-ba00-552f7a90c38e => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:15:24.995967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-3130778c-f232-4d0f-8c42-62d20a18a37f req-5fcf45c3-736a-4c13-a191-ecb33ad0b1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0f9c51-ab73-4450-8f3e-eb5d492a34d0", "tag": "5d658caa-5deb-4849-8248-3505cf81be8d"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:25.001186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=32 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:25.007096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-3130778c-f232-4d0f-8c42-62d20a18a37f req-5fcf45c3-736a-4c13-a191-ecb33ad0b1f7 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:25.007575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-3130778c-f232-4d0f-8c42-62d20a18a37f req-5fcf45c3-736a-4c13-a191-ecb33ad0b1f7 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:25.008004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-3130778c-f232-4d0f-8c42-62d20a18a37f req-5fcf45c3-736a-4c13-a191-ecb33ad0b1f7 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:25.010881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:25.020487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-3130778c-f232-4d0f-8c42-62d20a18a37f req-5fcf45c3-736a-4c13-a191-ecb33ad0b1f7 service nova] Creating event network-changed:5d658caa-5deb-4849-8248-3505cf81be8d for instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 on hv-cinder-86020 Oct 10 12:15:25.025516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-3130778c-f232-4d0f-8c42-62d20a18a37f req-5fcf45c3-736a-4c13-a191-ecb33ad0b1f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034686 Oct 10 12:15:25.026509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 379/805] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:26.119306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9c9e1114-63d8-4a02-b1f1-4e340556bd9d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:26.121391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=31 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:26.126577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c9e1114-63d8-4a02-b1f1-4e340556bd9d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:26.129026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c9e1114-63d8-4a02-b1f1-4e340556bd9d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:26.129026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9c9e1114-63d8-4a02-b1f1-4e340556bd9d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:26.132166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:26.153101 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9c9e1114-63d8-4a02-b1f1-4e340556bd9d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Going to try to stop instance {{(pid=121298) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 12:15:26.365572 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9c9e1114-63d8-4a02-b1f1-4e340556bd9d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action" status: 202 len: 0 microversion: 2.1 time: 0.250080 Oct 10 12:15:26.366241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 427/806] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:15:26 2022] POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:15:26.376493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:26.377213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:26.384726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:26.385249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:26.385761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:26.386523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:26.387013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:26.387441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:26.531802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:26.540264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9a0034dd-a1c0-448d-bc45-457a857af5e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.169087 Oct 10 12:15:26.541512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 380/807] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:26 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:27.566208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:27.566950 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:27.574394 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:27.574919 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:27.575356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:27.576053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:27.576513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:27.576949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:27.713360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:27.722226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-994b0b8a-eb9a-494a-abd0-06adc6858dad tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.160641 Oct 10 12:15:27.722854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 428/808] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:27 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:28.748373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:28.748905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:28.756182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:28.756675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:28.757120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:28.757874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:28.758336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:28.758794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:28.894495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:28.902960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fc3514c5-cb71-44d4-8335-3021cf7553c5 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.158529 Oct 10 12:15:28.903533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 381/809] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:28 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:29.925694 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:29.926252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:29.933013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:29.933498 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:29.933928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:29.934638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:29.935110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:29.935549 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:30.078398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:30.087840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-10c0c26f-a8ae-427b-b2d5-d003fb8929bd tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.166058 Oct 10 12:15:30.088465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 429/810] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:29 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:31.111854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:31.112471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:31.119685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:31.120181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:31.120654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:31.121374 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:31.121831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:31.122259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:31.266861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:31.276767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-906ca892-2554-4f74-8e30-3982d1d66ffe tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.168705 Oct 10 12:15:31.277359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 382/811] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:31 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:32.301400 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:32.302441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:32.309503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:32.309992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:32.310430 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:32.311175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:32.311631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:32.312056 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:32.452519 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:32.460919 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-13fff810-0008-41cf-b4ea-657bc2554e75 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.163420 Oct 10 12:15:32.461661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 430/812] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:32 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:33.489199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:33.489849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:33.496574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:33.497068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:33.497531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:33.498227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:33.498700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:33.499130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:33.851305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:33.859220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-290a73f1-ce08-432e-a4c4-06c480403a20 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.373858 Oct 10 12:15:33.859795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 383/813] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:33 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:34.882014 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:34.882627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:34.889124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:34.889610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:34.890055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:34.890775 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:34.891236 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:34.891667 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:35.032372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:35.047130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b1ce6ad3-8fc8-4604-a984-5ed7bd79568d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.168543 Oct 10 12:15:35.048218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 431/814] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:34 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:36.078686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:36.079320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:36.085746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:36.086233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:36.086697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:36.087391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:36.087850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:36.088282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:36.228683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:36.238224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f392b678-b193-4b3e-9fd2-181fb6c58bce tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1673 microversion: 2.1 time: 0.163330 Oct 10 12:15:36.238988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 384/815] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:36 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:37.262269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:37.263062 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:37.269631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:37.272241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:37.272241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:37.272241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:37.272241 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:37.272619 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:37.403742 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:37.411348 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b8696d82-338a-4e85-bb48-e88efa2caca9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1650 microversion: 2.1 time: 0.153036 Oct 10 12:15:37.411948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 432/816] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:37 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1650 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:37.434035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c7d9e14b-303a-48f3-b96c-f17702aa8d17 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:37.440660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c7d9e14b-303a-48f3-b96c-f17702aa8d17 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:37.441132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c7d9e14b-303a-48f3-b96c-f17702aa8d17 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:37.441551 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c7d9e14b-303a-48f3-b96c-f17702aa8d17 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:37.504097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c7d9e14b-303a-48f3-b96c-f17702aa8d17 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Going to try to start instance {{(pid=121297) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 12:15:37.677811 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c7d9e14b-303a-48f3-b96c-f17702aa8d17 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action" status: 202 len: 0 microversion: 2.1 time: 0.247385 Oct 10 12:15:37.678482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 385/817] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:15:37 2022] POST /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:15:37.686650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:37.687298 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:37.693839 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:37.694319 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:37.694847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:37.700015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:37.700015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:37.700015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:37.832015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:37.841391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d1b02532-a489-41ed-bd0d-d6940200d3d8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1659 microversion: 2.1 time: 0.158466 Oct 10 12:15:37.841977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 433/818] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:37 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1659 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:38.866748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:38.867354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:38.873603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:38.874079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:38.874512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:38.875220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:38.875669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:38.876105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:39.002199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:39.009965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ea84e5fe-5eff-43f6-9c83-debdd15bb001 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1659 microversion: 2.1 time: 0.148178 Oct 10 12:15:39.010539 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 386/819] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:38 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1659 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:15:40.033536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:40.034121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:40.041110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:40.041616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:40.042045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:40.042767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:40.043218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:40.043638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:40.175112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:40.183201 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8b35ea7f-1d6f-47f6-9fda-648d69c79145 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1663 microversion: 2.1 time: 0.153796 Oct 10 12:15:40.183775 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 434/820] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:40 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:43.213052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:43.213695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:43.220503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.221005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.221441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.222129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.222578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.223024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.247986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-385dc85a-ec34-42fa-90ad-ff97aa9693bb tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3/ips" status: 200 len: 149 microversion: 2.1 time: 0.039503 Oct 10 12:15:43.248574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 387/821] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:15:43 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:43.261338 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7999157-a978-46b4-b273-468d69c5c54e"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:43.265203 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:43.270438 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.270956 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.272055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.272767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.273222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.273650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.363942 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Invalid volume: volume d7999157-a978-46b4-b273-468d69c5c54e is already attached to instances: 2bb9c640-3e33-4e42-a21e-cdcce980b06a Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: POST /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3/os-volume_attachments HTTP/1.1 Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 74 Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:15:43.365902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {"volumeAttachment": {"volumeId": "d7999157-a978-46b4-b273-468d69c5c54e"}} Oct 10 12:15:43.369307 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Invalid volume: volume d7999157-a978-46b4-b273-468d69c5c54e is already attached to instances: 2bb9c640-3e33-4e42-a21e-cdcce980b06a Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'server_id': 'd0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3', 'body': {'volumeAttachment': {'volumeId': 'd7999157-a978-46b4-b273-468d69c5c54e'}}} Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d7999157-a978-46b4-b273-468d69c5c54e is already attached to instances: 2bb9c640-3e33-4e42-a21e-cdcce980b06a Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:43.371969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d7999157-a978-46b4-b273-468d69c5c54e is already attached to instances: 2bb9c640-3e33-4e42-a21e-cdcce980b06a Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:43.374877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d7999157-a978-46b4-b273-468d69c5c54e is already attached to instances: 2bb9c640-3e33-4e42-a21e-cdcce980b06a Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 400 to user: Invalid volume: volume d7999157-a978-46b4-b273-468d69c5c54e is already attached to instances: 2bb9c640-3e33-4e42-a21e-cdcce980b06a {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2e5b751a-b8af-41b5-9a07-8f78ecc18b0f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111072 Oct 10 12:15:43.377954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 435/822] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:15:43 2022] POST /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:15:43.379163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:43.379163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:43.384140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.384663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.385106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.385917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.386329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.386786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.415359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:15:43.686340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d63c3bb4-4e9f-4982-bd5e-d8141d8ba934 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 204 len: 0 microversion: 2.1 time: 0.312902 Oct 10 12:15:43.687262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 388/823] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:15:43 2022] DELETE /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:15:43.702393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:43.703039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:43.710629 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.711129 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.711568 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.712335 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:43.712793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:43.713215 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:43.851281 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:43.859869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-251eb968-2093-4512-8503-44b6632c673d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1681 microversion: 2.1 time: 0.161947 Oct 10 12:15:43.860658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 436/824] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:43 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:44.884215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:44.884915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:44.891508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:44.891994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:44.892435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:44.893143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:44.893598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:44.894021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:45.028772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:45.036393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-224a5758-2ff5-4ee1-a0c2-ee518a5936f3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1681 microversion: 2.1 time: 0.156440 Oct 10 12:15:45.037617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 389/825] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:44 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:46.060386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:46.060997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:46.067794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:46.068284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:46.068726 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:46.069438 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:46.069883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:46.070315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:46.206252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:46.214471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-589f3f15-180f-457c-8f9a-af0adf197749 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1681 microversion: 2.1 time: 0.157979 Oct 10 12:15:46.215074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 437/826] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:46 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:47.238569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:47.239641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:47.249200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:47.249713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:47.250152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:47.250955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:47.251415 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:47.251884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:47.319594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:47.330392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-06c18740-6504-4185-a79b-f9f5be54c793 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1613 microversion: 2.1 time: 0.095670 Oct 10 12:15:47.346698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 390/827] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:47 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:47.386484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-4b32f987-858b-4606-8b9b-358fa089aca1 req-8176d09a-ab0a-4dc3-95b7-85fbdea15133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3", "name": "network-vif-deleted", "tag": "0ced9ae0-41b3-43d6-830e-32265066d50b"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:47.392792 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-4b32f987-858b-4606-8b9b-358fa089aca1 req-8176d09a-ab0a-4dc3-95b7-85fbdea15133 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:47.393273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-4b32f987-858b-4606-8b9b-358fa089aca1 req-8176d09a-ab0a-4dc3-95b7-85fbdea15133 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:47.393724 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-4b32f987-858b-4606-8b9b-358fa089aca1 req-8176d09a-ab0a-4dc3-95b7-85fbdea15133 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:47.405944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-4b32f987-858b-4606-8b9b-358fa089aca1 req-8176d09a-ab0a-4dc3-95b7-85fbdea15133 service nova] Creating event network-vif-deleted:0ced9ae0-41b3-43d6-830e-32265066d50b for instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 on hv-cinder-86020 Oct 10 12:15:47.419406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-4b32f987-858b-4606-8b9b-358fa089aca1 req-8176d09a-ab0a-4dc3-95b7-85fbdea15133 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 Oct 10 12:15:47.419406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 438/828] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:48.356466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:48.357081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:48.364392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:48.364909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:48.365617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:48.367121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:48.367433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:48.367856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:48.405990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:48.405990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:48.405990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:48.405990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:15:48.452495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:48.466782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ce4c25ff-df6c-4fac-a1f7-8430bef412e0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 200 len: 1331 microversion: 2.1 time: 0.114084 Oct 10 12:15:48.467453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 391/829] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:48 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:49.493074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:49.493801 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:49.500342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:49.500827 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:49.501267 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:49.501960 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:49.502416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:49.502917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:49.517019 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 HTTP/1.1 Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:15:49.518743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:15:49.520231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': 'd0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3'} Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:15:49.521181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:15:49.523390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:49.524737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:15:49.524737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4180569a-e618-4d51-b447-57998476a43e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 404 len: 111 microversion: 2.1 time: 0.032191 Oct 10 12:15:49.524737 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 439/830] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:49 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:15:49.530008 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-99099d06-83f0-4fea-a301-9be192dec02d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '.version_select at 0x7f6d1284c0d0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:49.619344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-99099d06-83f0-4fea-a301-9be192dec02d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877456162" status: 202 len: 0 microversion: 2.1 time: 0.093019 Oct 10 12:15:49.619826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 392/831] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 10 12:15:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877456162 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:15:50.450592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:50.451126 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:50.457760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:50.458255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:50.458714 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:50.459523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:50.459978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:50.460410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:50.550334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'services' on Instance uuid 2bb9c640-3e33-4e42-a21e-cdcce980b06a {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:15:50.907771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-71103956-4033-41ff-b9d1-d77ccda37516 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments/d7999157-a978-46b4-b273-468d69c5c54e" status: 202 len: 0 microversion: 2.1 time: 0.461018 Oct 10 12:15:50.908399 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 440/832] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:15:50 2022] DELETE /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments/d7999157-a978-46b4-b273-468d69c5c54e => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:15:50.918387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:50.920615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:50.928170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:50.933135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:50.933135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:50.933135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:50.933135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:50.933619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:50.962647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a08a2728-1302-4925-97b4-8c68751f29a8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048809 Oct 10 12:15:50.964201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 393/833] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:15:50 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:51.977071 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:51.979363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:51.985577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:51.986039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:51.986467 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:51.987177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:51.987624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:51.988041 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:52.018106 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d7adf631-cc4d-4156-9955-da022f716c3d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Oct 10 12:15:52.018657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 441/834] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:15:51 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:53.031099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:53.033311 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:53.039745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:53.040218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:53.040653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:53.041331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:53.041777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:53.042199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:53.068532 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:53.073412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1e558b69-ff98-42ad-a1da-daeb48da96cd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046364 Oct 10 12:15:53.073793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 394/835] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:15:53 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:15:53.140561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:53.141115 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:53.148219 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:53.150020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:53.150020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:53.150020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:53.150420 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:53.150954 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:53.175715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Going to try to terminate instance {{(pid=121298) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:15:53.199764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:53.434417 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4b77fe51-3ccb-40fc-b57a-b0fb3a49349c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 204 len: 0 microversion: 2.1 time: 0.297390 Oct 10 12:15:53.435047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 442/836] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:15:53 2022] DELETE /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:15:53.443454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:53.445114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:53.451675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:53.452214 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:53.452658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:53.453365 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:53.453819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:53.454250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:53.588676 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:53.596636 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1b833642-e863-4ced-bc11-2eada6ebec0e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1682 microversion: 2.1 time: 0.157166 Oct 10 12:15:53.597189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 395/837] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:53 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:54.352767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:54.353329 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:54.359740 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.360213 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.360642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.361322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.361766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.362189 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.390709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-92c85a45-4004-4a0b-af67-f5c8e482b421 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments/03c00883-b7e9-4e23-b3f1-d30a5883f62c" status: 200 len: 194 microversion: 2.20 time: 0.042914 Oct 10 12:15:54.391284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 443/838] 10.222.0.46 () {60 vars in 1454 bytes} [Mon Oct 10 12:15:54 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments/03c00883-b7e9-4e23-b3f1-d30a5883f62c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:15:54.462138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:54.462738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:54.469741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.470225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.470652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.473009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.473009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.473009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.554940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lazy-loading 'services' on Instance uuid 3e51573a-beab-4197-840e-a9427a52e273 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:15:54.619817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:54.620441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:54.626585 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.627097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.627533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.628231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.628685 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.629109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.766087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c1d5be9a-5260-4fd3-9cc9-2378d775c965 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments/03c00883-b7e9-4e23-b3f1-d30a5883f62c" status: 202 len: 0 microversion: 2.20 time: 0.308381 Oct 10 12:15:54.767272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 396/839] 10.222.0.46 () {60 vars in 1457 bytes} [Mon Oct 10 12:15:54 2022] DELETE /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments/03c00883-b7e9-4e23-b3f1-d30a5883f62c => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:15:54.769431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:54.780502 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-dd024be4-3fb6-4640-812f-ea2f01449e3c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1682 microversion: 2.1 time: 0.164670 Oct 10 12:15:54.782308 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 444/840] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:54 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:54.789904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:54.792451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:54.799567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.800051 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.800492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.801195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:54.801682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:54.802120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:54.835194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a10c38ac-35c8-49ce-b02e-5d74cc9b31f9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051633 Oct 10 12:15:54.835971 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 397/841] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 10 12:15:54 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:15:55.754821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-5d3344a9-df75-4e72-b058-890a4017239e req-6199dc00-62f4-4126-b15d-885eb9cf335d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb9c640-3e33-4e42-a21e-cdcce980b06a", "name": "network-vif-deleted", "tag": "f65861f8-ce58-4ca5-a150-dd1cbc87aba1"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:15:55.765844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-5d3344a9-df75-4e72-b058-890a4017239e req-6199dc00-62f4-4126-b15d-885eb9cf335d service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:55.766648 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-5d3344a9-df75-4e72-b058-890a4017239e req-6199dc00-62f4-4126-b15d-885eb9cf335d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:55.767118 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-5d3344a9-df75-4e72-b058-890a4017239e req-6199dc00-62f4-4126-b15d-885eb9cf335d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:55.780238 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-5d3344a9-df75-4e72-b058-890a4017239e req-6199dc00-62f4-4126-b15d-885eb9cf335d service nova] Creating event network-vif-deleted:f65861f8-ce58-4ca5-a150-dd1cbc87aba1 for instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a on hv-cinder-86020 Oct 10 12:15:55.785608 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-5d3344a9-df75-4e72-b058-890a4017239e req-6199dc00-62f4-4126-b15d-885eb9cf335d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034612 Oct 10 12:15:55.786259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 445/842] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:15:55.806296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:55.807177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:55.813890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:55.814484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:55.815026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:55.815808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:55.816347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:55.816849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:55.850060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:55.853385 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:55.861123 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:55.862055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:55.863461 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:55.864399 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:55.865064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:55.866431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:55.893366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:55.906836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-339a1f40-197b-4990-bdb6-8fea9991a0ee tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1614 microversion: 2.1 time: 0.105551 Oct 10 12:15:55.921966 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4da36b88-257e-4e11-b2ba-6c51d6f2ddd8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075316 Oct 10 12:15:55.922927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 398/843] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:55 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:55.924549 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 446/844] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 10 12:15:55 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:15:56.932584 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:56.933194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:56.935624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:56.936015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:56.939596 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:56.941853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:56.942214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:56.942323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:56.942699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:56.946014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:56.946014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:56.946014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:56.947556 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:56.948036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:56.948471 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:56.949160 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:56.949771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:56.950201 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:56.980144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:56.980784 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:56.981328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:56.981634 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-32bf817c-7520-44de-a14f-5b0eed6374e0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052570 Oct 10 12:15:56.982021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid 2bb9c640-3e33-4e42-a21e-cdcce980b06a {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:15:56.988003 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 447/845] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 10 12:15:56 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:57.029138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:57.037368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3c6a9843-b863-4a6a-bc00-018870ec665c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1331 microversion: 2.1 time: 0.108841 Oct 10 12:15:57.038105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 399/846] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:56 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:57.062369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:57.062898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:57.070613 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:57.071268 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:57.071802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:57.072591 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:57.073146 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:57.073447 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:57.099270 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Going to try to terminate instance {{(pid=121298) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:15:57.422850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1f770a43-4cc6-413a-9daf-6076aaa4a311 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 204 len: 0 microversion: 2.20 time: 0.363877 Oct 10 12:15:57.424384 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 448/847] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 10 12:15:57 2022] DELETE /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 12:15:57.432765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:57.433768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:57.439290 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:57.439772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:57.440209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:57.440908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:57.441360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:57.441783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:57.583514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:57.592719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:57.594444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:57.595636 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f6439a2c-d772-45d3-b3fe-78d57449779b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.167441 Oct 10 12:15:57.596198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 400/848] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:15:57 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:15:58.062821 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:58.063530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:58.070751 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:58.071320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:58.071775 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:58.072481 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:58.072945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:58.073372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:58.104908 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:58.105389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:58.105827 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:58.106276 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid 2bb9c640-3e33-4e42-a21e-cdcce980b06a {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:15:58.148439 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:58.156255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c6cf26b3-f24c-4ecf-bc51-654e0fac97d8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 200 len: 1331 microversion: 2.1 time: 0.097692 Oct 10 12:15:58.156826 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 449/849] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:58 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:15:58.622205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:58.622866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:58.629958 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:58.630449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:58.630951 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:58.631699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:58.632160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:58.632595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:58.778065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:58.786709 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:58.788819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:58.789977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-31a82df6-490d-460c-9781-0969a50d6491 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.171869 Oct 10 12:15:58.790543 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 401/850] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:15:58 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:15:59.179887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:59.180505 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:59.187114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:59.187604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:59.188039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:59.188758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:59.189210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:59.189636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:59.204228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a HTTP/1.1 Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:15:59.206848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:15:59.208359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': '2bb9c640-3e33-4e42-a21e-cdcce980b06a'} Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:15:59.209063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:15:59.210179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:15:59.211272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:15:59.211272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d4163a6b-67bc-4ef9-b6a5-5095ab7500b1 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 404 len: 111 microversion: 2.1 time: 0.032127 Oct 10 12:15:59.211272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 450/851] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:15:59 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:15:59.216764 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-148b04a7-72cf-419f-bbd8-b52797fc8625 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '.version_select at 0x7f6d129fa430>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:59.280558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-148b04a7-72cf-419f-bbd8-b52797fc8625 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360399903" status: 202 len: 0 microversion: 2.1 time: 0.067704 Oct 10 12:15:59.281181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 402/852] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 10 12:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360399903 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:15:59.816211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:15:59.816980 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:15:59.823898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:59.824460 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:59.828228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:59.828228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:15:59.828228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:15:59.828228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:15:59.966609 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:59.975770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:59.977369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:15:59.978553 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-1154724c-7162-49b3-9398-fc81850a05a5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1725 microversion: 2.20 time: 0.166371 Oct 10 12:15:59.979142 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 451/853] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:15:59 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:16:00.433150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-470ec855-3707-452b-9b81-a2f846ca98b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: .version_select at 0x7f6d1287bee0>, body: {"keypair": {"name": "tempest-keypair-2067962079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7pYvKWd58oSDVOREw9hzSaYjnHb6egEI9tgbG4mdk+sFHn75Nw9ifJ8s+S5385Uw5hFZnSCjWRKGLw1DOQ8/2S5W2x+s/55KsiOSoIZJBJ3r8oltIxjk+YuzxSHaUbRA=="}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:00.458799 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-470ec855-3707-452b-9b81-a2f846ca98b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:16:00.465448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-470ec855-3707-452b-9b81-a2f846ca98b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:16:00.549770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-470ec855-3707-452b-9b81-a2f846ca98b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123631 Oct 10 12:16:00.550325 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 403/854] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:16:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:00.990039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-24e6fef3-ff2c-474b-9da1-be0e3fcb239d req-cbb926f5-353f-4dc7-8985-41dd2317f88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e51573a-beab-4197-840e-a9427a52e273", "name": "network-vif-deleted", "tag": "98e81f6a-0ff4-4344-ab00-e77663d7f2cf"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:01.007436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:01.008480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:01.022380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:01.023257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:01.026219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:01.027009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:01.027479 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:01.027921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:01.028744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-24e6fef3-ff2c-474b-9da1-be0e3fcb239d req-cbb926f5-353f-4dc7-8985-41dd2317f88e service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:01.029285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-24e6fef3-ff2c-474b-9da1-be0e3fcb239d req-cbb926f5-353f-4dc7-8985-41dd2317f88e service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:01.029725 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-24e6fef3-ff2c-474b-9da1-be0e3fcb239d req-cbb926f5-353f-4dc7-8985-41dd2317f88e service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:01.047357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-24e6fef3-ff2c-474b-9da1-be0e3fcb239d req-cbb926f5-353f-4dc7-8985-41dd2317f88e service nova] Creating event network-vif-deleted:98e81f6a-0ff4-4344-ab00-e77663d7f2cf for instance 3e51573a-beab-4197-840e-a9427a52e273 on hv-cinder-86020 Oct 10 12:16:01.062297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-24e6fef3-ff2c-474b-9da1-be0e3fcb239d req-cbb926f5-353f-4dc7-8985-41dd2317f88e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068904 Oct 10 12:16:01.062297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 452/855] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:01.116660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:01.125438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:01.126902 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:01.128096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-22bbf290-39ee-48a6-b641-7dcdf8865246 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1657 microversion: 2.20 time: 0.127462 Oct 10 12:16:01.128938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 404/856] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:00 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1657 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:02.154992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:02.155691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:02.171706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:02.171706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:02.171706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:02.171706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:02.172229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:02.172229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:02.203592 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:02.203894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:02.204336 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:02.204789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lazy-loading 'fault' on Instance uuid 3e51573a-beab-4197-840e-a9427a52e273 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:02.262222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:02.274556 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:02.276059 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:02.277283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6ffb41b1-e3b7-425f-92a6-8e0662991466 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 200 len: 1372 microversion: 2.20 time: 0.127098 Oct 10 12:16:02.277847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 453/857] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:02 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:03.305496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:03.306093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:03.312865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:03.313461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:03.313855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:03.314473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:03.315133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:03.315554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:03.331044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] HTTP exception thrown: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Request method failure captured: Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 HTTP/1.1 Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsfEAnwDHsAhpjCXAfeDuQhWD63I_4Er2RvSbFNdNHOCBiR21CW9DgROmj5QXEnA39MDKjJ9Z5D0GaYVvmxNL__ws5ixHkWkatmgCDTbeUpZwy4Kjj83gAmhXxQHgIbckr4I81Yz_ZyMNM9fY19nGcu3eBcyvrvpvpvJR7WqjjXMQA Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:16:03.333050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af22e9604d79499aa9b7c2ee3cef156d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: a7a87488f78444c3ad820527e5fbc099 Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:16:03.335352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '3e51573a-beab-4197-840e-a9427a52e273'} Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:16:03.336189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:16:03.337722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:03.339006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Returning 404 to user: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:16:03.339006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bb032005-75f5-4fe4-8830-85863bf35d89 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 404 len: 111 microversion: 2.20 time: 0.033525 Oct 10 12:16:03.339006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 405/858] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:03 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:16:03.349181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-76598c03-7455-41a5-bc2c-8a3f09a72ad8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '.version_select at 0x7f6d12919310>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:03.354548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-452904793", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f74af49-8f08-437e-8de8-52cf94d07154"}], "security_groups": [{"name": "tempest-securitygroup--736325218"}], "key_name": "tempest-keypair-2067962079", "user_data": "}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:03.465880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] validate_networks() for [('3f74af49-8f08-437e-8de8-52cf94d07154', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:16:03.475296 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-76598c03-7455-41a5-bc2c-8a3f09a72ad8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362175690" status: 204 len: 0 microversion: 2.20 time: 0.133369 Oct 10 12:16:03.475992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 454/859] 10.222.0.46 () {60 vars in 1262 bytes} [Mon Oct 10 12:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362175690 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 12:16:04.125603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:16:04.126039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:16:04.126568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:16:04.127079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:16:04.127647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:16:04.138493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:04.139003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:04.139587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:04.140283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:04.140744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:04.141202 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:04.159438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:16:04.164339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:16:04.176027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:16:04.179062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:16:04.357939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-58426978-35b9-4e5a-9b33-4391bf76bb23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.008105 Oct 10 12:16:04.360046 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 406/860] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:16:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:16:04.371428 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9a7b33cc-2963-400c-acfa-978fb81a68d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:04.372053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9a7b33cc-2963-400c-acfa-978fb81a68d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:04.465707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9a7b33cc-2963-400c-acfa-978fb81a68d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:04.481622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9a7b33cc-2963-400c-acfa-978fb81a68d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1241 microversion: 2.1 time: 0.111250 Oct 10 12:16:04.481622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 455/861] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:04 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:04.547532 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-790974c9-e76a-425f-ac97-3771234910c7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'create', calling method: .version_select at 0x7f6d16258040>, body: {"keypair": {"name": "tempest-keypair-1073367506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpz+V+mENwziSFoUSDj5p7oSnxH7iBLq/zNBhA1RXiJAWR56sOgijaHtMGJjzF+i8I7XcNPX1h2sJouQ3Im2hbWDy5WSDb73iazzyQGKIQIEg+RXJXOTSF/B4FJM13gDA=="}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:04.718024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-790974c9-e76a-425f-ac97-3771234910c7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:16:04.722489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-790974c9-e76a-425f-ac97-3771234910c7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for user a7a87488f78444c3ad820527e5fbc099 and project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:16:04.829946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-790974c9-e76a-425f-ac97-3771234910c7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.286378 Oct 10 12:16:04.830774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 407/862] 10.222.0.46 () {62 vars in 1200 bytes} [Mon Oct 10 12:16:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 12:16:05.504911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:05.507898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:05.512969 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:05.513484 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:05.513927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:05.514650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:05.515168 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:05.515577 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:05.583111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:05.590720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e8656301-3cdf-434d-94bc-e841943a655d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1245 microversion: 2.1 time: 0.090436 Oct 10 12:16:05.591317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 456/863] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:05 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:06.615049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:06.615739 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:06.622113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:06.622605 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:06.623072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:06.623777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:06.624238 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:06.624664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:06.691994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:06.700543 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-822e695c-b857-4bd9-aed7-36ed4020be15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1293 microversion: 2.1 time: 0.090025 Oct 10 12:16:06.701480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 408/864] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:06 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:07.725616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:07.728006 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:07.735396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:07.736108 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:07.736686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:07.737431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:07.737885 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:07.738309 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:07.803531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:07.811413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c15a31c9-a7b1-4fa3-a1ff-0a92c068c45b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1299 microversion: 2.1 time: 0.089832 Oct 10 12:16:07.828793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 457/865] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:07 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:07.829263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1870389665", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bb565bd-53c5-4c6d-b08f-259f391c730b"}], "security_groups": [{"name": "tempest-securitygroup--790453746"}], "key_name": "tempest-keypair-1073367506", "user_data": "}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:07.946062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] validate_networks() for [('8bb565bd-53c5-4c6d-b08f-259f391c730b', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:16:08.375016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:16:08.375704 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:16:08.376293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:16:08.376957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:16:08.377934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:16:08.388581 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:08.389201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:08.389772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:08.390648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:08.391229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:08.391841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:08.410174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:16:08.414186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Getting quotas for user a7a87488f78444c3ad820527e5fbc099 and project af22e9604d79499aa9b7c2ee3cef156d. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:16:08.425712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:16:08.427882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:16:08.625970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9f30fa8f-b66b-4a63-87c1-923931d7e7d5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.803610 Oct 10 12:16:08.626621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 409/866] 10.222.0.46 () {62 vars in 1188 bytes} [Mon Oct 10 12:16:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 12:16:08.638043 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cef8e0a3-ebde-4d84-9e1e-2f6225140170 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:08.638655 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cef8e0a3-ebde-4d84-9e1e-2f6225140170 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:08.694696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cef8e0a3-ebde-4d84-9e1e-2f6225140170 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:08.710318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cef8e0a3-ebde-4d84-9e1e-2f6225140170 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:08.710318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cef8e0a3-ebde-4d84-9e1e-2f6225140170 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:08.710318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cef8e0a3-ebde-4d84-9e1e-2f6225140170 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1282 microversion: 2.20 time: 0.075978 Oct 10 12:16:08.711284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 458/867] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:08 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:08.839930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:08.841171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:08.850120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:08.850749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:08.851863 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:08.852718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:08.853293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:08.853822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:08.990224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:08.999005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3d1e53b5-63a7-4add-af28-87674ee41f6e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.163993 Oct 10 12:16:09.000769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 410/868] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:08 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:09.072927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-d1c405f8-6131-433d-97e1-dfc15d657eb0 req-c6c8a2ed-7f6e-485f-a407-5d8f9e7d6ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1476dd01-f830-450e-a00a-4e4c54345b44", "tag": "07d8609f-409c-413a-b79d-ca897650173a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:09.085866 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-d1c405f8-6131-433d-97e1-dfc15d657eb0 req-c6c8a2ed-7f6e-485f-a407-5d8f9e7d6ce6 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:09.086434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-d1c405f8-6131-433d-97e1-dfc15d657eb0 req-c6c8a2ed-7f6e-485f-a407-5d8f9e7d6ce6 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:09.086988 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-d1c405f8-6131-433d-97e1-dfc15d657eb0 req-c6c8a2ed-7f6e-485f-a407-5d8f9e7d6ce6 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:09.099079 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-d1c405f8-6131-433d-97e1-dfc15d657eb0 req-c6c8a2ed-7f6e-485f-a407-5d8f9e7d6ce6 service nova] Creating event network-changed:07d8609f-409c-413a-b79d-ca897650173a for instance 1476dd01-f830-450e-a00a-4e4c54345b44 on hv-cinder-86020 Oct 10 12:16:09.106198 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-d1c405f8-6131-433d-97e1-dfc15d657eb0 req-c6c8a2ed-7f6e-485f-a407-5d8f9e7d6ce6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039330 Oct 10 12:16:09.107110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 459/869] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:09.737516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:09.738246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:09.744847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:09.745331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:09.745822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:09.746514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:09.746988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:09.747612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:09.815157 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:09.824194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:09.825679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:09.826839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7a99ac73-d1b9-420a-85e2-bef4c796bd00 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1286 microversion: 2.20 time: 0.093313 Oct 10 12:16:09.827408 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 411/870] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:09 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:10.022319 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:10.022986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:10.029336 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:10.029813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:10.030250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:10.030953 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:10.031408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:10.031863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:10.168688 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:10.176571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-45deb2f2-3e0c-48bd-a348-c798f528ab1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.158550 Oct 10 12:16:10.181152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 460/871] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:10 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:10.852869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:10.853410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:10.859859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:10.860334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:10.860766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:10.861440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:10.861884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:10.862303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:10.923076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:10.931835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:10.933280 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:10.934376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f424e60f-93a8-4a5c-a5eb-f2c90639c45d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1278 microversion: 2.20 time: 0.086051 Oct 10 12:16:10.934956 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 412/872] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:10 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:11.200331 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:11.200941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:11.207564 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:11.208049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:11.208537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:11.209221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:11.209672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:11.210098 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:11.338930 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:11.341269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:11.347642 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7c13d05d-e653-4430-b440-ffb9a817bfd3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.151267 Oct 10 12:16:11.348157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 461/873] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:11 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:11.959165 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:11.959763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:11.967172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:11.967663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:11.968104 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:11.969103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:11.969564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:11.969993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:12.033126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:12.041464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:12.043041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:12.044131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8f8b9082-b6da-447f-9bbb-2152746125d8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1278 microversion: 2.20 time: 0.089015 Oct 10 12:16:12.044682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 413/874] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:11 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:12.371914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:12.372442 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:12.379195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:12.379674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:12.380153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:12.380843 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:12.381296 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:12.381721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:12.518640 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:12.526326 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-caba3955-1399-4d2c-b584-af6fd81530ef tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.159391 Oct 10 12:16:12.526920 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 462/875] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:12 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:13.069665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:13.071048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:13.077661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:13.078160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:13.078603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:13.079337 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:13.079888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:13.080269 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:13.143119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:13.152175 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:13.153607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:13.154771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d9663622-80cb-4e60-a397-0b11ba15bb60 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1278 microversion: 2.20 time: 0.089295 Oct 10 12:16:13.155318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 414/876] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:13 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:13.549466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:13.550145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:13.557061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:13.557545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:13.557984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:13.558717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:13.559172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:13.559597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:13.692976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:13.701513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e5cc88c3-de78-495f-8302-9a18d3c9d91d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.155885 Oct 10 12:16:13.702094 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 463/877] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:13 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:14.181652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:14.182291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:14.188942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:14.189423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:14.189856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:14.190538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:14.191012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:14.191470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:14.207225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:14.512357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:14.523364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:14.524165 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:14.525382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d0a64277-6ea3-4377-bac4-80661dfadfc3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1342 microversion: 2.20 time: 0.348384 Oct 10 12:16:14.540565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 415/878] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:14 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1342 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:14.725476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:14.726177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:14.732638 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:14.733155 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:14.733586 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:14.734273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:14.734748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:14.735169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:14.866252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:14.874443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c7c6bf62-4e7a-45e0-83cd-d4fc54f1c5bc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.152856 Oct 10 12:16:14.875615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 464/879] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:14 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:15.555376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:15.556151 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:15.562848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:15.563428 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:15.563877 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:15.564586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:15.565043 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:15.565688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:15.701898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:15.711531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:15.714269 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:15.714269 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6589413a-3a52-4ada-9844-8d81f2cf3242 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.164415 Oct 10 12:16:15.714820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 416/880] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:15 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:15.809892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-36830914-44ba-4896-ac03-84066d5285f3 req-4f7dcb2e-025f-4865-b4af-bd11cc2e5745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b", "tag": "d904bf77-5a1e-4848-a3d8-d43e634f0c09"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:15.821588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-36830914-44ba-4896-ac03-84066d5285f3 req-4f7dcb2e-025f-4865-b4af-bd11cc2e5745 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:15.822421 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-36830914-44ba-4896-ac03-84066d5285f3 req-4f7dcb2e-025f-4865-b4af-bd11cc2e5745 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:15.823211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-36830914-44ba-4896-ac03-84066d5285f3 req-4f7dcb2e-025f-4865-b4af-bd11cc2e5745 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:15.836194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-36830914-44ba-4896-ac03-84066d5285f3 req-4f7dcb2e-025f-4865-b4af-bd11cc2e5745 service nova] Creating event network-changed:d904bf77-5a1e-4848-a3d8-d43e634f0c09 for instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b on hv-cinder-86020 Oct 10 12:16:15.841921 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-36830914-44ba-4896-ac03-84066d5285f3 req-4f7dcb2e-025f-4865-b4af-bd11cc2e5745 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035816 Oct 10 12:16:15.843114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 465/881] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:15.897358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:15.898521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:15.905306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:15.912278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:15.912278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:15.912498 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-156654a5-5b63-4727-8b21-0ae6458b2c04 req-047d6177-b3b0-476c-baff-7a1d4ab3a95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1476dd01-f830-450e-a00a-4e4c54345b44", "name": "network-vif-plugged", "status": "completed", "tag": "07d8609f-409c-413a-b79d-ca897650173a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:15.912621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:15.912621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:15.912621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:15.917202 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-156654a5-5b63-4727-8b21-0ae6458b2c04 req-047d6177-b3b0-476c-baff-7a1d4ab3a95d service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:15.917693 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-156654a5-5b63-4727-8b21-0ae6458b2c04 req-047d6177-b3b0-476c-baff-7a1d4ab3a95d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:15.918126 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-156654a5-5b63-4727-8b21-0ae6458b2c04 req-047d6177-b3b0-476c-baff-7a1d4ab3a95d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:15.929908 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-156654a5-5b63-4727-8b21-0ae6458b2c04 req-047d6177-b3b0-476c-baff-7a1d4ab3a95d service nova] Creating event network-vif-plugged:07d8609f-409c-413a-b79d-ca897650173a for instance 1476dd01-f830-450e-a00a-4e4c54345b44 on hv-cinder-86020 Oct 10 12:16:15.936889 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-156654a5-5b63-4727-8b21-0ae6458b2c04 req-047d6177-b3b0-476c-baff-7a1d4ab3a95d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Oct 10 12:16:15.937731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 466/882] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:16.047682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:16.063292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ca0b6277-0ebe-44e0-866c-c12b3c5e84b0 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.169728 Oct 10 12:16:16.064167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 417/883] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:15 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:16.744099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:16.744805 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:16.751616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:16.752104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:16.752543 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:16.753250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:16.753704 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:16.754434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:16.886620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:16.894892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:16.896341 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:16.897483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ee7bc7ce-9a6e-4a22-8630-2974f59166f4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.160360 Oct 10 12:16:16.898036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 467/884] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:16 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:17.085602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:17.086220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:17.093433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:17.093975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:17.094423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:17.095175 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:17.095637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:17.096065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:17.234270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:17.243405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0641d6da-ea8e-4e47-897a-d15e87983b1b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.161770 Oct 10 12:16:17.243992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 418/885] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:17 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:17.923190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:17.923793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:17.930620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:17.931122 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:17.931551 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:17.932499 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:17.932947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:17.933366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:18.060255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:18.068250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:18.070285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:18.071413 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6869669b-8499-4eeb-aadb-a57ad1a8e196 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.152166 Oct 10 12:16:18.071970 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 468/886] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:17 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:18.265606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:18.266227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:18.272819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:18.273325 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:18.273766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:18.274475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:18.274969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:18.275400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:18.399596 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=4 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:18.416611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:18.420797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=20 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:18.425820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5a9ad25c-dc97-4bf5-b89b-77d986628bbd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.164133 Oct 10 12:16:18.426463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 419/887] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:18 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:19.097074 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:19.097614 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:19.099637 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=4 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:19.105718 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:19.106215 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:19.106659 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:19.107454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:19.107944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:19.108392 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:19.239114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:19.247337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:19.248819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:19.249901 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-08f904e0-9738-43ec-828d-f82ed035d32b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.157164 Oct 10 12:16:19.250465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 469/888] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:19 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:19.450518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:19.451155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:19.458364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:19.458875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:19.459307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:19.460000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:19.461071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:19.461488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:19.598262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:19.606142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fd748790-5753-4c3e-84d1-09c8fb1b7449 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.159939 Oct 10 12:16:19.606735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 420/889] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:19 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:20.275849 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:20.276462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:20.283422 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:20.283819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:20.284260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:20.285032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:20.285488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:20.285914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:20.414754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:20.423082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:20.424524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:20.425636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-70a323d6-5742-4f8e-9bc7-a5e82502b110 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.154337 Oct 10 12:16:20.426195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 470/890] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:20 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:20.629556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:20.630174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:20.633040 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=8 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:20.637819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:20.638320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:20.638949 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:20.639613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:20.640070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:20.644317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:20.778030 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:20.786075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-db5a5647-4c58-4349-9561-df8dd502ac90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1366 microversion: 2.1 time: 0.160383 Oct 10 12:16:20.786649 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 421/891] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:20 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:21.450251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:21.450993 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:21.458040 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:21.458541 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:21.459018 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:21.459745 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:21.460208 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:21.460649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:21.610877 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:21.620478 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:21.621957 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:21.623181 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b4ab7827-f939-48f5-a5a6-37a0867c9e25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.177038 Oct 10 12:16:21.623753 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 471/892] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:21 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:21.810108 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:21.810993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:21.818259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:21.818848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:21.819315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:21.820071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:21.820532 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:21.820969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:21.971645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:21.980457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dcb07479-37e3-455b-bb09-bf65fab78f5c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1556 microversion: 2.1 time: 0.174720 Oct 10 12:16:21.981219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 422/893] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:21 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:22.014133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:22.014627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:22.021233 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:22.021721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:22.022186 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:22.023432 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:22.023890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:22.024315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:22.116262 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-157176ea-221f-4290-b5ad-33218742e849 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106101 Oct 10 12:16:22.116864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 472/894] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:16:22 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:22.649670 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:22.650393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:22.656883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:22.657380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:22.657829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:22.658571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:22.659066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:22.659500 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:22.903994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:22.913800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:22.915357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:22.916517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3813bff0-3624-4bc4-b1dd-e80a37796c40 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.271909 Oct 10 12:16:22.917097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 423/895] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:22 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:16:23.410376 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-18013c4f-abcc-4f34-9b8d-aa4fbbddbfcb req-4ceb7467-9540-441d-af2c-b79680c2a2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1476dd01-f830-450e-a00a-4e4c54345b44", "tag": "07d8609f-409c-413a-b79d-ca897650173a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:23.421006 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18013c4f-abcc-4f34-9b8d-aa4fbbddbfcb req-4ceb7467-9540-441d-af2c-b79680c2a2a1 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:23.421487 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18013c4f-abcc-4f34-9b8d-aa4fbbddbfcb req-4ceb7467-9540-441d-af2c-b79680c2a2a1 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:23.421923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-18013c4f-abcc-4f34-9b8d-aa4fbbddbfcb req-4ceb7467-9540-441d-af2c-b79680c2a2a1 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:23.434150 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-18013c4f-abcc-4f34-9b8d-aa4fbbddbfcb req-4ceb7467-9540-441d-af2c-b79680c2a2a1 service nova] Creating event network-changed:07d8609f-409c-413a-b79d-ca897650173a for instance 1476dd01-f830-450e-a00a-4e4c54345b44 on hv-cinder-86020 Oct 10 12:16:23.439298 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-18013c4f-abcc-4f34-9b8d-aa4fbbddbfcb req-4ceb7467-9540-441d-af2c-b79680c2a2a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190746 Oct 10 12:16:23.441203 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 473/896] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:23.954314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:23.955723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:23.969432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:23.970730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:23.972666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:23.974732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:23.976020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:23.976995 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:24.083317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-0e18e455-8d6c-45b8-86e7-d745b951d7f9 req-6ff08537-60a7-44e9-a226-d4fd57415010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b", "name": "network-vif-plugged", "status": "completed", "tag": "d904bf77-5a1e-4848-a3d8-d43e634f0c09"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:24.099733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0e18e455-8d6c-45b8-86e7-d745b951d7f9 req-6ff08537-60a7-44e9-a226-d4fd57415010 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:24.106813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0e18e455-8d6c-45b8-86e7-d745b951d7f9 req-6ff08537-60a7-44e9-a226-d4fd57415010 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:24.106813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0e18e455-8d6c-45b8-86e7-d745b951d7f9 req-6ff08537-60a7-44e9-a226-d4fd57415010 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:24.123636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-0e18e455-8d6c-45b8-86e7-d745b951d7f9 req-6ff08537-60a7-44e9-a226-d4fd57415010 service nova] Creating event network-vif-plugged:d904bf77-5a1e-4848-a3d8-d43e634f0c09 for instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b on hv-cinder-86020 Oct 10 12:16:24.129318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-0e18e455-8d6c-45b8-86e7-d745b951d7f9 req-6ff08537-60a7-44e9-a226-d4fd57415010 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051218 Oct 10 12:16:24.129942 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 474/897] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:16:24.172870 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:24.184793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:24.186533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:24.188062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eb7c5fcb-973d-4a18-b0df-9ac07899c5c1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.245641 Oct 10 12:16:24.188651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 424/898] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:23 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:25.215748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:25.216466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:25.223594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:25.224082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:25.224523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:25.225234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:25.225692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:25.226123 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:25.372224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:25.380670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:25.382110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:25.383814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d7d458bc-99ba-4150-ad4e-15caeef8439b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1407 microversion: 2.20 time: 0.173480 Oct 10 12:16:25.384386 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 475/899] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:25 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:16:26.409407 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:26.410018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:26.417320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:26.417797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:26.418233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:26.418980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:26.419469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:26.419894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:26.555794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:26.565091 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:26.566523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:26.567778 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8f3e102c-0c68-467b-b9d1-09dedee24669 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1599 microversion: 2.20 time: 0.162410 Oct 10 12:16:26.568680 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 425/900] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:16:26 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:16:26.594685 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:26.597258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:26.606544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:26.607079 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:26.607509 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:26.608222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:26.608699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:26.609162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:26.692357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-04a51b1d-b0dc-4a6d-8dea-fe7d92be3f24 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102384 Oct 10 12:16:26.693193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 476/901] 10.222.0.46 () {60 vars in 1316 bytes} [Mon Oct 10 12:16:26 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:16:27.941282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-e0040efa-4868-4358-a358-878ae6b7c46c req-8f9a38a4-2cf5-4272-b26d-763b0be556bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b", "tag": "d904bf77-5a1e-4848-a3d8-d43e634f0c09"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:27.951477 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-e0040efa-4868-4358-a358-878ae6b7c46c req-8f9a38a4-2cf5-4272-b26d-763b0be556bf service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:27.951978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-e0040efa-4868-4358-a358-878ae6b7c46c req-8f9a38a4-2cf5-4272-b26d-763b0be556bf service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:27.952406 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-e0040efa-4868-4358-a358-878ae6b7c46c req-8f9a38a4-2cf5-4272-b26d-763b0be556bf service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:27.964448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-e0040efa-4868-4358-a358-878ae6b7c46c req-8f9a38a4-2cf5-4272-b26d-763b0be556bf service nova] Creating event network-changed:d904bf77-5a1e-4848-a3d8-d43e634f0c09 for instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b on hv-cinder-86020 Oct 10 12:16:27.970000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-e0040efa-4868-4358-a358-878ae6b7c46c req-8f9a38a4-2cf5-4272-b26d-763b0be556bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032332 Oct 10 12:16:27.970935 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 426/902] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:29.473661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:29.474197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:29.476817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:29.482003 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:29.482415 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:29.482893 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:29.483897 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:29.484038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:29.484466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:29.571591 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'services' on Instance uuid 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:29.776625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8e9ae350-5075-4b16-b76d-21629fe9f753 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments/1650ed00-e240-4a59-832f-b20c03b6364a" status: 202 len: 0 microversion: 2.1 time: 0.307374 Oct 10 12:16:29.777306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 477/903] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:16:29 2022] DELETE /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments/1650ed00-e240-4a59-832f-b20c03b6364a => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:16:29.786867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:29.789286 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:29.796536 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:29.797028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:29.797478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:29.798230 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:29.798735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:29.799131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:29.833028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a42109c6-0b9a-45be-9599-fa37f9ec5a73 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050781 Oct 10 12:16:29.833602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 427/904] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:16:29 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:30.848334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:30.850864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:30.858309 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:30.858848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:30.859294 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:30.860022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:30.860483 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:30.860912 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:30.894127 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f1fb0274-8ecc-4353-a0f5-c6c9a5cfc1cf tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051137 Oct 10 12:16:30.894732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 478/905] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:16:30 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:31.908099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:31.910327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:31.917839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:31.919887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:31.919887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:31.919887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:31.919887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:31.920807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:31.951531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c9e4384f-01b8-491a-9269-8fba4dc4e6c8 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047734 Oct 10 12:16:31.954389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 428/906] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:16:31 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 12:16:32.035836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:32.036382 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:32.043668 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:32.044157 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:32.044598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:32.045301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:32.045756 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:32.046184 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:32.075412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Going to try to terminate instance {{(pid=121298) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:16:32.221961 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:32.428345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-469d4cf3-c3ab-4847-bfe6-d7489aa1e393 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 204 len: 0 microversion: 2.1 time: 0.396014 Oct 10 12:16:32.429111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 479/907] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:16:32 2022] DELETE /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:16:32.438036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:32.438710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:32.445714 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:32.446211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:32.446651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:32.447377 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:32.447844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:32.448354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:32.595391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:32.604055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a22c71e1-fcf5-4b07-ad91-6bc266cb1d6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1688 microversion: 2.1 time: 0.170130 Oct 10 12:16:32.604638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 429/908] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:32 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:33.628228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:33.628925 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:33.635545 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:33.636026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:33.636522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:33.637156 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:33.637607 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:33.638029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:33.770911 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:33.779757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3334b740-2eb7-45ff-aacb-7b963e7ed8ce tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1688 microversion: 2.1 time: 0.155836 Oct 10 12:16:33.780350 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 480/909] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:33 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:34.803893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:34.804414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:34.811919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:34.812403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:34.812849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:34.813547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:34.813998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:34.814420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:34.952306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:34.960386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-29b7fe67-3364-475f-9b92-a03b7154fef9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1688 microversion: 2.1 time: 0.160491 Oct 10 12:16:34.961084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 430/910] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:34 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:35.984272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:35.985061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:35.991971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:35.992462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:35.993397 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:35.994110 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:35.994567 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:35.995026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:36.131070 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:36.139644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4950489d-8cac-4d62-bcb4-4f472e45c143 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1688 microversion: 2.1 time: 0.159354 Oct 10 12:16:36.140239 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 481/911] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:35 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:36.488439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-a0518cd6-ac5d-4fcd-a277-219a286d25e6 req-826a4193-4338-492c-9c52-c5fa827b75d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0f9c51-ab73-4450-8f3e-eb5d492a34d0", "name": "network-vif-deleted", "tag": "5d658caa-5deb-4849-8248-3505cf81be8d"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:36.500309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a0518cd6-ac5d-4fcd-a277-219a286d25e6 req-826a4193-4338-492c-9c52-c5fa827b75d3 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:36.500923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a0518cd6-ac5d-4fcd-a277-219a286d25e6 req-826a4193-4338-492c-9c52-c5fa827b75d3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:36.501437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a0518cd6-ac5d-4fcd-a277-219a286d25e6 req-826a4193-4338-492c-9c52-c5fa827b75d3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:36.513420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-a0518cd6-ac5d-4fcd-a277-219a286d25e6 req-826a4193-4338-492c-9c52-c5fa827b75d3 service nova] Creating event network-vif-deleted:5d658caa-5deb-4849-8248-3505cf81be8d for instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 on hv-cinder-86020 Oct 10 12:16:36.518858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-a0518cd6-ac5d-4fcd-a277-219a286d25e6 req-826a4193-4338-492c-9c52-c5fa827b75d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036127 Oct 10 12:16:36.531461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 431/912] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:37.162700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:37.163553 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:37.170034 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:37.170534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:37.171017 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:37.171733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:37.172194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:37.172626 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:37.206032 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:37.206516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:37.207001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:37.207456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'fault' on Instance uuid 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:37.250027 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:37.261250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d7a07d2b-16e5-4bdd-af21-2551c1a92ea3 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 200 len: 1334 microversion: 2.1 time: 0.102441 Oct 10 12:16:37.261854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 482/913] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:37 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:38.286038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:38.286758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:38.293682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:38.294196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:38.294640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:38.295368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:38.295828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:38.296255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:38.309928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] HTTP exception thrown: Instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 could not be found. Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Request method failure captured: Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 HTTP/1.1 Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAse6dTSTQcasFgmOM7hNbdxasgbqo82IjkVxrYw2tk_rJqyxLGlSAqrgg96TLD1T8o3wQz_qR3TL3WYm3KepTG9jkOgrJiEiPrnb5-27tfxw2QaoRgf1EvzKsW3HwmQK7s9i1NsfM12drhVq6WvVFRVzCRNEMZZ_w3K-YxOc8pn98E Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:16:38.311685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_782c5fd84235487caac5f9a7e18563cb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 45c87aa85b7d45fe8acf6f36a3d2a639 Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 could not be found. Oct 10 12:16:38.314813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '6f0f9c51-ab73-4450-8f3e-eb5d492a34d0'} Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 could not be found. Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:16:38.315776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 could not be found. Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 could not be found. Oct 10 12:16:38.317292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:38.318388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Returning 404 to user: Instance 6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:16:38.318388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d68d3626-1fc0-409a-a392-9fc00e1bb02c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0" status: 404 len: 111 microversion: 2.1 time: 0.031979 Oct 10 12:16:38.318388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 432/914] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:38 2022] GET /compute/v2.1/servers/6f0f9c51-ab73-4450-8f3e-eb5d492a34d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:16:38.322012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-918cf425-96d9-4134-a34e-4d1445fcfd82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '.version_select at 0x7f6d129f28b0>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:38.393819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-918cf425-96d9-4134-a34e-4d1445fcfd82 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839708287" status: 202 len: 0 microversion: 2.1 time: 0.075526 Oct 10 12:16:38.394320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 483/915] 10.222.0.46 () {58 vars in 1218 bytes} [Mon Oct 10 12:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839708287 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:16:41.852921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:41.853565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:41.860544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:41.864419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:41.864419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:41.864419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:41.864419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:41.864818 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:41.888944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:16:41.903628 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:42.239263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b533ec9e-4199-4b17-a139-029c94dab26c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 204 len: 0 microversion: 2.1 time: 0.390357 Oct 10 12:16:42.239933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 433/916] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:16:41 2022] DELETE /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:16:42.249475 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:42.254711 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:42.256334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:42.256852 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:42.257259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:42.257959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:42.258418 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:42.258894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:42.390395 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:42.399209 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f0b6d757-12cc-4870-812c-e322a1eb851b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1509 microversion: 2.1 time: 0.154304 Oct 10 12:16:42.399715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 484/917] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:42 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:43.425864 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:43.426640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:43.433414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:43.433827 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:43.434273 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:43.435011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:43.435476 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:43.435914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:43.588300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:43.596678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-89b68df3-169c-4aef-9e34-bb13d792f59f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1509 microversion: 2.1 time: 0.175221 Oct 10 12:16:43.597401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 434/918] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:43 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:43.674876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:43.675366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:43.681692 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:43.682177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:43.682721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:43.683438 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:43.683872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:43.684297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:43.710356 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Going to try to terminate instance {{(pid=121298) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:16:43.778644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-54914803-a96e-4702-8910-c3b6ac6d8099 req-a3caf32f-151c-4d66-b0a7-29ea76d1ba67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a693f249-110a-4836-a0db-7c668d53a918", "name": "network-vif-deleted", "tag": "7952dcbe-5751-4c3a-ad46-5f684e765d16"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:43.789033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-54914803-a96e-4702-8910-c3b6ac6d8099 req-a3caf32f-151c-4d66-b0a7-29ea76d1ba67 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:43.789531 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-54914803-a96e-4702-8910-c3b6ac6d8099 req-a3caf32f-151c-4d66-b0a7-29ea76d1ba67 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:43.789969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-54914803-a96e-4702-8910-c3b6ac6d8099 req-a3caf32f-151c-4d66-b0a7-29ea76d1ba67 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:43.804779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-54914803-a96e-4702-8910-c3b6ac6d8099 req-a3caf32f-151c-4d66-b0a7-29ea76d1ba67 service nova] Creating event network-vif-deleted:7952dcbe-5751-4c3a-ad46-5f684e765d16 for instance a693f249-110a-4836-a0db-7c668d53a918 on hv-cinder-86020 Oct 10 12:16:43.811180 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-54914803-a96e-4702-8910-c3b6ac6d8099 req-a3caf32f-151c-4d66-b0a7-29ea76d1ba67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037445 Oct 10 12:16:43.811675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 435/919] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:16:44.011558 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0661e15f-c382-46dd-a091-4e6a246b294d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 204 len: 0 microversion: 2.1 time: 0.455855 Oct 10 12:16:44.012183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 485/920] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:16:43 2022] DELETE /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:16:44.021592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:44.024334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:44.030878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:44.031481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:44.031911 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:44.032641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:44.033090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:44.033507 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:44.194983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:44.203970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-42f3742e-712b-4cd5-ac29-27e79df166f0 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1577 microversion: 2.1 time: 0.186935 Oct 10 12:16:44.204583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 436/921] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:44 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:44.622402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:44.623176 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:44.630099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:44.630588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:44.631065 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:44.631778 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:44.632235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:44.632664 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:44.665418 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:44.666401 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:44.666889 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:44.667349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'fault' on Instance uuid a693f249-110a-4836-a0db-7c668d53a918 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:44.712299 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:44.723754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-05fee49a-203b-4800-87e9-7caab2e9d645 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1312 microversion: 2.1 time: 0.106341 Oct 10 12:16:44.724357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 486/922] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:44 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:45.228063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:45.228942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:45.235821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:45.236314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:45.236759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:45.237463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:45.237918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:45.238349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:45.391967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:45.400971 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1070e703-c40d-4221-9145-2c723623c77a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1577 microversion: 2.1 time: 0.176769 Oct 10 12:16:45.401555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 437/923] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:45 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:45.747652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:45.748179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:45.754944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:45.755435 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:45.755878 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:45.756627 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:45.757037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:45.757467 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:45.790407 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:45.791528 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:45.791925 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:45.792443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'fault' on Instance uuid a693f249-110a-4836-a0db-7c668d53a918 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:45.836185 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:45.845135 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-649e2c66-9103-468b-a5f6-a5455b9c148c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 200 len: 1312 microversion: 2.1 time: 0.101561 Oct 10 12:16:45.845705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 487/924] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:45 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:46.424813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:46.425489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:46.432171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:46.432668 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:46.433107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:46.434310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:46.434816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:46.435250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:46.570648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:46.579090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-867252c4-be57-46aa-aee7-213830e14a8d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1577 microversion: 2.1 time: 0.158193 Oct 10 12:16:46.579762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 438/925] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:46 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:46.868715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:46.869439 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: a693f249-110a-4836-a0db-7c668d53a918] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:46.876610 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:46.877303 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:46.877758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:46.878478 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:46.878968 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:46.879400 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:46.895177 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] HTTP exception thrown: Instance a693f249-110a-4836-a0db-7c668d53a918 could not be found. Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Request method failure captured: Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 HTTP/1.1 Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAse6dTSTQcasFgmOM7hNbdxasgbqo82IjkVxrYw2tk_rJqyxLGlSAqrgg96TLD1T8o3wQz_qR3TL3WYm3KepTG9jkOgrJiEiPrnb5-27tfxw2QaoRgf1EvzKsW3HwmQK7s9i1NsfM12drhVq6WvVFRVzCRNEMZZ_w3K-YxOc8pn98E Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:16:46.896887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_782c5fd84235487caac5f9a7e18563cb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: 45c87aa85b7d45fe8acf6f36a3d2a639 Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance a693f249-110a-4836-a0db-7c668d53a918 could not be found. Oct 10 12:16:46.899089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': 'a693f249-110a-4836-a0db-7c668d53a918'} Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a693f249-110a-4836-a0db-7c668d53a918 could not be found. Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:16:46.900141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a693f249-110a-4836-a0db-7c668d53a918 could not be found. Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a693f249-110a-4836-a0db-7c668d53a918 could not be found. Oct 10 12:16:46.901720 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:46.904214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Returning 404 to user: Instance a693f249-110a-4836-a0db-7c668d53a918 could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:16:46.904214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-99b8a05a-619e-4417-9a91-57158f1dd634 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918" status: 404 len: 111 microversion: 2.1 time: 0.034197 Oct 10 12:16:46.904214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 488/926] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:46 2022] GET /compute/v2.1/servers/a693f249-110a-4836-a0db-7c668d53a918 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:16:46.907782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:46.908282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:46.914393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:46.919454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:46.919454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:46.919454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:46.919454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:46.919853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:46.953494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:16:47.290954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8a1da239-b4f9-497e-89bc-74c9afe551b0 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 204 len: 0 microversion: 2.1 time: 0.386682 Oct 10 12:16:47.291643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 439/927] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:16:46 2022] DELETE /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:16:47.300284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:47.301282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:47.307770 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:47.308351 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:47.308735 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:47.309598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:47.310055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:47.312066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:47.465849 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:47.472724 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-17fe9a97-cd8e-49bb-9de7-8c3ac91b6f1c tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.176294 Oct 10 12:16:47.473350 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 489/928] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:47 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:47.605502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:47.606319 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:47.614728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:47.616014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:47.616014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:47.616645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:47.617320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:47.617875 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-dc1193f7-3648-4800-916c-bd519796f74f req-2658178d-4d16-4e78-999d-74fc5366dab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f92846d-2cb9-4e32-ae7a-a5a7d775bc36", "name": "network-vif-deleted", "tag": "25362498-cffe-413c-a09b-5810fd5593c4"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:47.618183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:47.627884 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-dc1193f7-3648-4800-916c-bd519796f74f req-2658178d-4d16-4e78-999d-74fc5366dab6 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:47.628454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-dc1193f7-3648-4800-916c-bd519796f74f req-2658178d-4d16-4e78-999d-74fc5366dab6 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:47.628959 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-dc1193f7-3648-4800-916c-bd519796f74f req-2658178d-4d16-4e78-999d-74fc5366dab6 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:47.643621 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-dc1193f7-3648-4800-916c-bd519796f74f req-2658178d-4d16-4e78-999d-74fc5366dab6 service nova] Creating event network-vif-deleted:25362498-cffe-413c-a09b-5810fd5593c4 for instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 on hv-cinder-86020 Oct 10 12:16:47.649440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-dc1193f7-3648-4800-916c-bd519796f74f req-2658178d-4d16-4e78-999d-74fc5366dab6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035427 Oct 10 12:16:47.650511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 490/929] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:16:47.697772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:47.707669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7269c48b-6f97-417d-a50d-9322f4e8aba3 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1510 microversion: 2.1 time: 0.108318 Oct 10 12:16:47.715637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 440/930] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:47 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1510 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:48.502453 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:48.503215 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:48.509872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:48.510360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:48.510887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:48.511588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:48.512114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:48.512542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:48.664606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:48.674081 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c38239c1-7306-4c7d-aeb9-1fe006d12609 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1521 microversion: 2.1 time: 0.176665 Oct 10 12:16:48.674644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 491/931] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:48 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:48.737413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:48.738458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:48.745640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:48.746249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:48.746705 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:48.747430 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:48.747893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:48.748328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:48.785200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:48.785691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:48.786161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:48.786618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lazy-loading 'fault' on Instance uuid 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:48.832829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:48.841499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a49c89b9-150c-4dd4-9623-ec60908fd851 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 200 len: 1229 microversion: 2.1 time: 0.112968 Oct 10 12:16:48.842098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 441/932] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:48 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:49.169824 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:49.172305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:49.178497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.179022 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.179593 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.180217 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.180678 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.181115 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.213527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-be0800f5-0810-4a6b-928f-0f5da1695b6b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047771 Oct 10 12:16:49.214144 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 492/933] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:16:49 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:16:49.280356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:49.280861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:49.287004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.287792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.287966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.288690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.289144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.289570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.320226 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:16:49.600112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0b832a59-1b46-429f-abe8-8e76b654f0c0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 204 len: 0 microversion: 2.1 time: 0.323419 Oct 10 12:16:49.600820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 442/934] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:16:49 2022] DELETE /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:16:49.610856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:49.614020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:49.618408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.618922 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.619434 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.620133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.620578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.620995 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.694467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-0cc40e59-15b5-416e-931b-a1564d0a3a68 req-e0ceff2c-0a19-4aea-beac-a7567336ca49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d92bcf3-e567-46a0-a87e-ab1f89a16842", "name": "network-vif-deleted", "tag": "baa47217-65c4-4e53-be16-7c13a9be2c74"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:49.704647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-0cc40e59-15b5-416e-931b-a1564d0a3a68 req-e0ceff2c-0a19-4aea-beac-a7567336ca49 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.705683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-0cc40e59-15b5-416e-931b-a1564d0a3a68 req-e0ceff2c-0a19-4aea-beac-a7567336ca49 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.705683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-0cc40e59-15b5-416e-931b-a1564d0a3a68 req-e0ceff2c-0a19-4aea-beac-a7567336ca49 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.720527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-0cc40e59-15b5-416e-931b-a1564d0a3a68 req-e0ceff2c-0a19-4aea-beac-a7567336ca49 service nova] Creating event network-vif-deleted:baa47217-65c4-4e53-be16-7c13a9be2c74 for instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 on hv-cinder-86020 Oct 10 12:16:49.725523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-0cc40e59-15b5-416e-931b-a1564d0a3a68 req-e0ceff2c-0a19-4aea-beac-a7567336ca49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035512 Oct 10 12:16:49.726130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 443/935] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:16:49.731934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:49.732857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:49.739695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.740344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.740641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.741345 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.741795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.742220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.770769 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:49.779802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d1ec9ee1-0329-4831-91d2-f19e3628e509 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1669 microversion: 2.1 time: 0.174295 Oct 10 12:16:49.780391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 493/936] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:49 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:49.807736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:49.816316 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6b4660ac-6ded-48bd-bd28-f6eb848cef0b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1479 microversion: 2.1 time: 0.088974 Oct 10 12:16:49.816910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 444/937] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:49 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1479 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:49.865572 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:49.866102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:49.872198 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.872682 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.873124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.873830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:49.874292 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:49.874751 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:49.889476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.wsgi [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] HTTP exception thrown: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Request method failure captured: Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: request: GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 HTTP/1.1 Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept: application/json Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Accept-Encoding: identity Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Connection: close Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Length: 0 Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Content-Type: application/json Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Host: 10.222.0.46 Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Openstack-System-Scope: None Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: User-Agent: python-urllib3/1.26.12 Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Auth-Token: gAAAAABjRAumOyQtgCSkjkt7yWBZ8BWxFImr9O1X5rNnXVoDcMBBghy_lnU6vaXH-HjGnDJp-RgVy_uf8g8v9PlerPbz1109H9dZmz4gCMpNQZDufUr9U6JmuVlw_ovaADxTK6m7ljddfrUBjzJQ_rLuWblCqKCTN34xt2OuQCU2BCSDXzekEo4 Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Id: None Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Domain-Name: None Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Identity-Status: Confirmed Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Is-Admin-Project: True Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Id: default Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Domain-Name: Default Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Project-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Role: member,reader Oct 10 12:16:49.891195 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Roles: member,reader Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26773079b6914a20ab27109b0dec496a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26773079b6914a20ab27109b0dec496a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant: tempest-TestVolumeBootPattern-555404953 Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-Tenant-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Id: default Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Domain-Name: Default Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Id: 21c537b0fefe4fb1b51483ac0e3cf2d1 Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: X-User-Name: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: method: > Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: exception: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:16:49.892701 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: action_args: {'id': '9f92846d-2cb9-4e32-ae7a-a5a7d775bc36'} Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:16:49.893530 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:16:49.894715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: ERROR nova.api.openstack.wsgi Oct 10 12:16:49.895860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Returning 404 to user: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. {{(pid=121298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:16:49.895860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a4822267-8ffd-4358-b8ef-f8fe6748428b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 404 len: 111 microversion: 2.1 time: 0.031089 Oct 10 12:16:49.895860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 494/938] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:49 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:16:49.948749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1268341387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1382985420", "security_groups": [{"name": "tempest-secgroup-smoke-390021896"}], "block_device_mapping_v2": [{"uuid": "8a673810-fcf0-4f5e-a261-159d410dfcac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "467adefb-be40-4a7b-be51-41e12ba7cbdd"}]}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:50.078868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] validate_networks() for [('467adefb-be40-4a7b-be51-41e12ba7cbdd', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:16:50.467102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:16:50.467102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:16:50.467102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:16:50.467102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:16:50.467102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:16:50.476354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:50.476906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:50.477340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:50.478076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:50.478533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:50.478979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:50.497947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Getting quotas for project 26773079b6914a20ab27109b0dec496a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:16:50.502167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Getting quotas for user 21c537b0fefe4fb1b51483ac0e3cf2d1 and project 26773079b6914a20ab27109b0dec496a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:16:50.578943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:16:50.581155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a673810-fcf0-4f5e-a261-159d410dfcac',volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:16:50.803814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:50.804494 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:50.811289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:50.811782 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:50.812231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:50.812947 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:50.813398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:50.813868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:50.880827 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:50.962991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:50.971858 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-15ee06cb-49ef-4206-b5d3-7a40a4704aba tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1669 microversion: 2.1 time: 0.172292 Oct 10 12:16:50.972440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 495/939] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:50 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:50.977076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:50.977674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:50.983571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:50.984056 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:50.984490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:50.985254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:50.985688 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:50.986109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:51.001854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:51.014314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6b66ac6e-5804-4c85-a558-9af95290e3ac tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.069591 Oct 10 12:16:51.016538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 445/940] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:16:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:16:51.020117 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:51.020603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:51.021552 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:51.021915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'fault' on Instance uuid 7d92bcf3-e567-46a0-a87e-ab1f89a16842 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:51.029804 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-88cc4777-ddaf-4248-8c4d-734010d90e9d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:51.033145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-88cc4777-ddaf-4248-8c4d-734010d90e9d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:51.100837 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:51.107389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-75cf58fc-ac99-4f70-949f-104e2f247c6f tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1311 microversion: 2.1 time: 0.133832 Oct 10 12:16:51.107976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 496/941] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:50 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:51.121145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-88cc4777-ddaf-4248-8c4d-734010d90e9d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:51.129486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-88cc4777-ddaf-4248-8c4d-734010d90e9d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1095 microversion: 2.1 time: 0.105991 Oct 10 12:16:51.135415 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 446/942] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:51 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:51.995331 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:51.996226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:52.004137 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.006624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.006624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.006624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.006624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.007245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.095265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:52.105492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-de475c24-7f98-4ac4-996e-99a7728c9e70 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1602 microversion: 2.1 time: 0.113508 Oct 10 12:16:52.106095 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 497/943] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:51 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1602 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:52.132534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:52.133164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:52.142733 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.143252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.143906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.144647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.145227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.145732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.155822 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:52.157644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:52.166702 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.168016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.168716 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.169712 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.170617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.171232 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.200439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.200941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.201437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.201858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lazy-loading 'fault' on Instance uuid 7d92bcf3-e567-46a0-a87e-ab1f89a16842 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:52.267851 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:52.277228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a8fe39d1-b7cb-4a4b-90cb-a2e84ffa760d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1145 microversion: 2.1 time: 0.127681 Oct 10 12:16:52.278387 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 498/944] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:52 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1145 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:52.299332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c87aa85b7d45fe8acf6f36a3d2a639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '782c5fd84235487caac5f9a7e18563cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:52.319406 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-11337322-d262-42b5-b72d-da0285b104a9 tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 200 len: 1311 microversion: 2.1 time: 0.185914 Oct 10 12:16:52.319406 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 447/945] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:52 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:52.391474 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-c3768135-b744-47d5-affd-0c367b30d7ca req-9f91b7ba-b637-4575-9933-2911f86990f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c0121a-4f1a-4265-9efd-5a969d73bb7e", "name": "network-vif-deleted", "tag": "63d53b17-0e7f-4e84-aa0c-4d6908cd174a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:52.404497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-c3768135-b744-47d5-affd-0c367b30d7ca req-9f91b7ba-b637-4575-9933-2911f86990f3 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:52.404981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-c3768135-b744-47d5-affd-0c367b30d7ca req-9f91b7ba-b637-4575-9933-2911f86990f3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:52.405615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-c3768135-b744-47d5-affd-0c367b30d7ca req-9f91b7ba-b637-4575-9933-2911f86990f3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:52.418935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-c3768135-b744-47d5-affd-0c367b30d7ca req-9f91b7ba-b637-4575-9933-2911f86990f3 service nova] Creating event network-vif-deleted:63d53b17-0e7f-4e84-aa0c-4d6908cd174a for instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e on hv-cinder-86020 Oct 10 12:16:52.424554 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-c3768135-b744-47d5-affd-0c367b30d7ca req-9f91b7ba-b637-4575-9933-2911f86990f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038675 Oct 10 12:16:52.425180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 499/946] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:16:53.135550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:53.137115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:53.145841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:53.146487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:53.147070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:53.148033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:53.148597 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:53.149213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:53.153651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:53.192598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:53.193164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:53.193612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:53.194071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lazy-loading 'fault' on Instance uuid 13c0121a-4f1a-4265-9efd-5a969d73bb7e {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:53.252123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:53.266570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-46bc1475-e19c-40d3-ae68-c09a4f6ff6f3 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1326 microversion: 2.1 time: 0.135907 Oct 10 12:16:53.280152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 448/947] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:53 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:53.305529 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:53.306654 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:53.319444 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:53.320035 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:53.320621 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:53.321465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:53.322310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:53.323082 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:53.342275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:53.344891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] [instance: 7d92bcf3-e567-46a0-a87e-ab1f89a16842] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:53.364027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:53.364920 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:53.366087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:53.367523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:53.368515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:53.369604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:53.399026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] HTTP exception thrown: Instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 could not be found. Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Request method failure captured: Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 HTTP/1.1 Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAse6dTSTQcasFgmOM7hNbdxasgbqo82IjkVxrYw2tk_rJqyxLGlSAqrgg96TLD1T8o3wQz_qR3TL3WYm3KepTG9jkOgrJiEiPrnb5-27tfxw2QaoRgf1EvzKsW3HwmQK7s9i1NsfM12drhVq6WvVFRVzCRNEMZZ_w3K-YxOc8pn98E Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:16:53.403227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_782c5fd84235487caac5f9a7e18563cb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/782c5fd84235487caac5f9a7e18563cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 782c5fd84235487caac5f9a7e18563cb Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-367915746 Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 45c87aa85b7d45fe8acf6f36a3d2a639 Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-ServerRescueNegativeTestJSON-367915746-project Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 could not be found. Oct 10 12:16:53.404758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '7d92bcf3-e567-46a0-a87e-ab1f89a16842'} Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 could not be found. Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:16:53.405619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 could not be found. Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 could not be found. Oct 10 12:16:53.407300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:53.409908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] Returning 404 to user: Instance 7d92bcf3-e567-46a0-a87e-ab1f89a16842 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:16:53.411066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ba0f3cf4-f829-4808-b82f-231d23177e3b tempest-ServerRescueNegativeTestJSON-367915746 tempest-ServerRescueNegativeTestJSON-367915746-project] 10.222.0.46 "GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842" status: 404 len: 111 microversion: 2.1 time: 0.076324 Oct 10 12:16:53.412018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 449/948] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:53 2022] GET /compute/v2.1/servers/7d92bcf3-e567-46a0-a87e-ab1f89a16842 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:16:53.436993 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:53.445928 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-81f7e491-2212-408e-8fa6-a7cad3e9328e tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1193 microversion: 2.1 time: 0.147488 Oct 10 12:16:53.447269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 500/949] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:53 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1193 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:54.291440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:54.292102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:54.298574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:54.299071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:54.299884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:54.300612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:54.301068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:54.301486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:54.338590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:54.339921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:54.340357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:54.340841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lazy-loading 'fault' on Instance uuid 13c0121a-4f1a-4265-9efd-5a969d73bb7e {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:16:54.407675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:54.416932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-309b7d9d-40e6-431b-ae44-7a126d9087c9 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 200 len: 1326 microversion: 2.1 time: 0.129241 Oct 10 12:16:54.417792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 450/950] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:54 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:54.493351 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:54.494915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:54.502036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:54.502531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:54.503016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:54.503747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:54.504205 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:54.504644 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:54.579262 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:54.593012 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-522f5bd5-b14f-48d4-93a2-085fabdc97b6 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1211 microversion: 2.1 time: 0.103609 Oct 10 12:16:54.593997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 501/951] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:54 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:55.441891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:55.442510 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:55.450338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:55.451040 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:55.451427 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:55.452123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:55.452585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:55.453119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:55.471423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] HTTP exception thrown: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Request method failure captured: Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e HTTP/1.1 Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAseUfMyYWX_8Ldf20rij5EuP9PdwtW_Btam8A5P25mk6sk_IHLyQgGwF7PfRW54UtPeKNW-6TxGyy0WsGjcuCzmjlfupVrdn3KUPRJBBxrfk7cbgExDnSvECaBSPuVb14Cx7ApMyVgLzTqlmvu75UQvmmySc1hItYMEgBnkcClMtyk Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:16:55.473111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_98437356d32f4230bce856ce6ddae66a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: b334b2401e14419284cce2ad61442d4a Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:16:55.474491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '13c0121a-4f1a-4265-9efd-5a969d73bb7e'} Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:16:55.475381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:16:55.476544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:16:55.477697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Returning 404 to user: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:16:55.477697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-44de26d1-060a-4187-b312-72d4afd35ba8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 404 len: 111 microversion: 2.1 time: 0.037279 Oct 10 12:16:55.477697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 451/952] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:55 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:16:55.485044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6d351ab9-0ed8-4534-bf02-864567271ac2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '.version_select at 0x7f6d128bb0d0>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:55.617642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:55.618889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:55.625509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:55.626006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:55.626445 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:55.627176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:55.627804 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:55.628235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:55.634344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6d351ab9-0ed8-4534-bf02-864567271ac2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-826154291" status: 202 len: 0 microversion: 2.1 time: 0.154179 Oct 10 12:16:55.635594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 502/953] 10.222.0.46 () {58 vars in 1218 bytes} [Mon Oct 10 12:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-826154291 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:16:55.887458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:55.899449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-57f7b577-b129-43fd-b837-c89e26081591 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1278 microversion: 2.1 time: 0.286110 Oct 10 12:16:55.900670 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 452/954] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:55 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1278 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:56.914909 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4a847901-6c9d-4424-8d49-394fef186e4b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'create', calling method: .version_select at 0x7f6d129a5820>, body: {"keypair": {"name": "tempest-keypair-1730073187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8GcykDUvQI4pnyp0rrgh1mT94vsMAtwSl3ii1K6bvtNicI189e6NQAXqzDbWE7ci5mzU9y6BUCCRiwsLcOt6UWXfrVQjLDjcS1Uig+bDy2F2+bBrz9MiB+DGwOzSlLwQ=="}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:56.935002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:56.936276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:56.943332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:56.944202 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:56.944374 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:56.944966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:56.945624 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:56.946237 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:56.952474 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-4a847901-6c9d-4424-8d49-394fef186e4b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for project 98437356d32f4230bce856ce6ddae66a. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:16:56.960573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-4a847901-6c9d-4424-8d49-394fef186e4b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for user b334b2401e14419284cce2ad61442d4a and project 98437356d32f4230bce856ce6ddae66a. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:16:57.104419 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4a847901-6c9d-4424-8d49-394fef186e4b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.191814 Oct 10 12:16:57.106883 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 503/955] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:16:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:16:57.117275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:57.136770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e13269ac-0071-43a0-b454-1d8fa49f915d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.204394 Oct 10 12:16:57.155515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 453/956] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:56 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:16:57.388845 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-f1272eca-c36d-4389-b2f4-dceb83762fd0 req-397a6a5d-15aa-46d2-b383-dc3c1aa510c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25", "tag": "7ba57a2d-ce5e-46be-bfeb-ce6690c962c7"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:16:57.397457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-f1272eca-c36d-4389-b2f4-dceb83762fd0 req-397a6a5d-15aa-46d2-b383-dc3c1aa510c8 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:57.397941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-f1272eca-c36d-4389-b2f4-dceb83762fd0 req-397a6a5d-15aa-46d2-b383-dc3c1aa510c8 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:57.398380 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-f1272eca-c36d-4389-b2f4-dceb83762fd0 req-397a6a5d-15aa-46d2-b383-dc3c1aa510c8 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:57.410761 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-f1272eca-c36d-4389-b2f4-dceb83762fd0 req-397a6a5d-15aa-46d2-b383-dc3c1aa510c8 service nova] Creating event network-changed:7ba57a2d-ce5e-46be-bfeb-ce6690c962c7 for instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 on hv-cinder-86020 Oct 10 12:16:57.415817 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-f1272eca-c36d-4389-b2f4-dceb83762fd0 req-397a6a5d-15aa-46d2-b383-dc3c1aa510c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035711 Oct 10 12:16:57.416440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 504/957] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:16:58.174585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:58.175281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:58.182141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:58.182641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:58.183110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:58.183834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:58.184302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:58.184725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:58.353419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:58.367676 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9fa6fd7a-3e28-4fbc-a848-2e5810074adf tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.196669 Oct 10 12:16:58.369006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 454/958] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:58 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:16:59.404669 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:16:59.406179 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:16:59.413236 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:59.414051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:59.414697 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:59.415422 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:16:59.416049 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:16:59.416798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:16:59.645612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:16:59.665992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-911dec58-0721-4d2c-a691-89d23852c5d9 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.266171 Oct 10 12:16:59.670260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 505/959] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:16:59 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:00.262619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-412700072", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8981a50-f1b5-4a9f-bc84-d19589293c21"}], "security_groups": [{"name": "tempest-securitygroup--1989844107"}], "key_name": "tempest-keypair-1730073187", "user_data": "}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:17:00.390576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] validate_networks() for [('f8981a50-f1b5-4a9f-bc84-d19589293c21', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:17:00.487480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:00.692790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:00.693578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:00.696168 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:00.703749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:00.705007 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:00.705985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:00.706870 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:00.707717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:00.711183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:00.904353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:17:00.905085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:17:00.905955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:17:00.906802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:17:00.907514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:17:00.924076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:00.924894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:00.925644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:00.926927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:00.927777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:00.928557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:00.933886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:00.944375 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-43fc2b6f-8dd9-44e5-8fdc-0324bc0725a4 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.255498 Oct 10 12:17:00.945217 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 506/960] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:00 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:00.951236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for project 98437356d32f4230bce856ce6ddae66a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:17:00.955369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Getting quotas for user b334b2401e14419284cce2ad61442d4a and project 98437356d32f4230bce856ce6ddae66a. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:17:00.967923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:17:00.970101 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:17:01.141187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d2354d8e-01ec-4552-9a79-4bbd91204b85 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.886277 Oct 10 12:17:01.141945 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 455/961] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:17:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:17:01.161431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ff038775-32e2-4d31-8612-f38715a34718 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:01.162822 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ff038775-32e2-4d31-8612-f38715a34718 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:01.241141 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ff038775-32e2-4d31-8612-f38715a34718 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:01.252026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ff038775-32e2-4d31-8612-f38715a34718 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1237 microversion: 2.1 time: 0.095744 Oct 10 12:17:01.255286 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 507/962] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:01 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:01.976262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:01.979141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:01.985577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:01.986082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:01.986520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:01.987301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:01.987757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:01.988184 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:02.152432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:02.160712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8942ce65-9a0b-4620-842d-b4bd985c9d89 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.188601 Oct 10 12:17:02.161453 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 456/963] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:01 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:02.275948 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:02.276814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:02.284265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:02.284615 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:02.285070 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:02.285779 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:02.286245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:02.286704 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:02.358519 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:02.367814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bf1fa0f5-8d53-4fb8-b761-7f723f7213e7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1241 microversion: 2.1 time: 0.097104 Oct 10 12:17:02.368584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 508/964] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:02 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:03.184885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:03.186039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:03.192142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:03.192651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:03.193092 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:03.193797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:03.194253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:03.194695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:03.337123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:03.346570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-01c66cb5-6a55-4377-801c-b2b234dc18c5 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.165531 Oct 10 12:17:03.347341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 457/965] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:03 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:03.392136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:03.392897 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:03.400304 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:03.400812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:03.401369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:03.403033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:03.403708 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:03.404194 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:03.471097 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:03.478965 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a7c960f7-0763-4ada-8323-e471513d1c15 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1289 microversion: 2.1 time: 0.090884 Oct 10 12:17:03.479724 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 509/966] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:03 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:04.371038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:04.371971 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:04.379229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:04.379821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:04.380423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:04.381201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:04.381925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:04.382409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:04.502582 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:04.503863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:04.511162 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:04.511661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:04.512165 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:04.512914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:04.513573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:04.514013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:04.533253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:04.545214 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0810fe65-e34d-44ed-b638-2180c52d0bab tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.177855 Oct 10 12:17:04.545970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 458/967] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:04 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:04.582746 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:04.591524 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c582c540-6f8d-4dd3-8d19-3b3d4d90c425 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1295 microversion: 2.1 time: 0.093286 Oct 10 12:17:04.592112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 510/968] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:04 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:05.568208 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:05.569027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:05.576286 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:05.576838 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:05.577285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:05.577996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:05.578457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:05.579126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:05.616762 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:05.617567 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:05.625967 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:05.626748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:05.630229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:05.630229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:05.630229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:05.630229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:05.784691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:05.809925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-25526996-a14d-4d91-95b5-3ca7e7c68133 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.229936 Oct 10 12:17:05.809925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 459/969] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:05 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:05.834748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:05.843548 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2b6832ca-e362-468f-a38f-44acf766543a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.230711 Oct 10 12:17:05.844142 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 511/970] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:05 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:05.953360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-d6464b94-6bcb-4082-964d-2ee3c510b0d0 req-14eb0ec8-3fbb-49ce-b6c7-b2f4d33d2af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e7774e-b8b3-4e69-967d-c19741018ddf", "tag": "1837ddef-a7eb-4bd3-b4f5-a127aa82e594"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:17:05.963020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d6464b94-6bcb-4082-964d-2ee3c510b0d0 req-14eb0ec8-3fbb-49ce-b6c7-b2f4d33d2af5 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:05.963495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d6464b94-6bcb-4082-964d-2ee3c510b0d0 req-14eb0ec8-3fbb-49ce-b6c7-b2f4d33d2af5 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:05.963957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-d6464b94-6bcb-4082-964d-2ee3c510b0d0 req-14eb0ec8-3fbb-49ce-b6c7-b2f4d33d2af5 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:05.977120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-d6464b94-6bcb-4082-964d-2ee3c510b0d0 req-14eb0ec8-3fbb-49ce-b6c7-b2f4d33d2af5 service nova] Creating event network-changed:1837ddef-a7eb-4bd3-b4f5-a127aa82e594 for instance b5e7774e-b8b3-4e69-967d-c19741018ddf on hv-cinder-86020 Oct 10 12:17:05.980781 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-d6464b94-6bcb-4082-964d-2ee3c510b0d0 req-14eb0ec8-3fbb-49ce-b6c7-b2f4d33d2af5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031067 Oct 10 12:17:05.981388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 460/971] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:17:06.817782 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:06.818408 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:06.825804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:06.826297 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:06.826766 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:06.827481 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:06.827944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:06.828372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:06.868801 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:06.869511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:06.876601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:06.877395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:06.877833 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:06.878543 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:06.879039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:06.879443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:07.023298 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:07.032864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3f343cb3-6895-43d8-bfe1-76d4791f4212 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.219091 Oct 10 12:17:07.033836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 512/972] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:06 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:07.059004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:07.066711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a78d09d8-f7b6-4738-94cf-3218abe3f5be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.202709 Oct 10 12:17:07.067499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 461/973] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:06 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:08.056782 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:08.057409 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:08.064794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:08.065350 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:08.065798 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:08.066732 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:08.067199 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:08.067641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:08.090288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:08.090931 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:08.098124 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:08.098609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:08.099448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:08.100002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:08.100456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:08.100908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:08.261170 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:08.269189 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6d030035-0eab-4dd3-b3b2-975985e7eeb7 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.216298 Oct 10 12:17:08.269786 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 513/974] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:08 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:08.293450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:08.301906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cf728eb4-3160-4246-b483-d1726099d764 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.216320 Oct 10 12:17:08.302507 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 462/975] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:08 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:09.304620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:09.304620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:09.304620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:09.304620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:09.305686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:09.305686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:09.305686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:09.305686 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:09.328560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:09.329725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:09.340420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:09.341012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:09.341592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:09.342772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:09.343327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:09.343798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:09.497491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:09.505282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2f6ded78-6265-4767-b7c3-650fce1bd67a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.216593 Oct 10 12:17:09.505856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 514/976] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:09 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:09.529096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:09.537567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-53fd5c10-b18e-4cca-b35d-24152aa0891e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.215146 Oct 10 12:17:09.539674 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 463/977] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:09 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:10.528554 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:10.529211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:10.536038 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:10.536534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:10.536984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:10.537871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:10.538256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:10.538705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:10.562202 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:10.562852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:10.569709 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:10.570208 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:10.570653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:10.571383 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:10.571842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:10.572272 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:10.941785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:10.962509 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:10.963048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=14 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:10.970642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:10.972293 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-00dcdf9c-2f6f-421f-ab2e-7d0323886527 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.448256 Oct 10 12:17:10.973404 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 515/978] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:10 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:10.978774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8a6b4b68-530c-41bc-a866-fd2df943d511 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.420376 Oct 10 12:17:10.979649 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 464/979] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:10 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:11.995402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:11.996026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:11.998164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=6 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:12.001952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:12.002707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:12.004707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:12.005840 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:12.006707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:12.010756 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:12.010756 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:12.010756 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:12.012235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:12.012235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:12.012235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:12.012929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:12.012929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:12.014562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:12.215806 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:12.219523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:12.224231 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bc7da25e-54c8-4646-8328-f1b5543acb30 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.232659 Oct 10 12:17:12.228055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 516/980] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:11 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:12.228201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-797cecd0-9721-4e09-af04-ee0b35896d9f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.230061 Oct 10 12:17:12.228294 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 465/981] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:11 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:13.248617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:13.249234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:13.252282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:13.252896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:13.255706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:13.256202 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:13.256652 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:13.257360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:13.257856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:13.258278 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:13.259275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:13.259756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:13.260189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:13.260874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:13.260988 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:13.261326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:13.261747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:13.454755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:13.463446 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d18a3465-c784-4457-90d8-2c26d52f66f1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.219398 Oct 10 12:17:13.468454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 517/982] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:13 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:13.472486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:13.474715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:13.482136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-523e50a8-83a6-4fab-b2ad-4ea2e96490f7 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.233844 Oct 10 12:17:13.482759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 466/983] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:13 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:14.487337 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:14.487960 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:14.494513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:14.495023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:14.495511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:14.496712 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:14.497172 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:14.497601 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:14.508881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:14.510217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:14.517091 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:14.517717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:14.518259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:14.519080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:14.520066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:14.520066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:14.784508 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:14.794434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:14.800706 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-4cdd6641-e108-46b6-ad41-edc1f9f360e1 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.317097 Oct 10 12:17:14.803617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 518/984] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:14 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:14.809272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-021839ad-526d-4ea4-a18f-fb9b44d1fa36 req-2ee323e5-205c-4de0-ac3d-7bf9ebdfaebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25", "name": "network-vif-plugged", "status": "completed", "tag": "7ba57a2d-ce5e-46be-bfeb-ce6690c962c7"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:17:14.818775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-53bbfff4-9031-4c58-8590-405341fbcae8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.314374 Oct 10 12:17:14.818775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 467/985] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:14 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:14.820580 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-021839ad-526d-4ea4-a18f-fb9b44d1fa36 req-2ee323e5-205c-4de0-ac3d-7bf9ebdfaebc service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:14.821317 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-021839ad-526d-4ea4-a18f-fb9b44d1fa36 req-2ee323e5-205c-4de0-ac3d-7bf9ebdfaebc service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:14.821763 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-021839ad-526d-4ea4-a18f-fb9b44d1fa36 req-2ee323e5-205c-4de0-ac3d-7bf9ebdfaebc service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:14.835322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-021839ad-526d-4ea4-a18f-fb9b44d1fa36 req-2ee323e5-205c-4de0-ac3d-7bf9ebdfaebc service nova] Creating event network-vif-plugged:7ba57a2d-ce5e-46be-bfeb-ce6690c962c7 for instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 on hv-cinder-86020 Oct 10 12:17:14.843230 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-021839ad-526d-4ea4-a18f-fb9b44d1fa36 req-2ee323e5-205c-4de0-ac3d-7bf9ebdfaebc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038014 Oct 10 12:17:14.844489 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 519/986] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:17:15.858866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:15.859776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:15.866602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:15.868943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:15.868943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:15.868943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:15.868943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:15.869306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:15.869865 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:15.871202 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:15.878031 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:15.878522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:15.878992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:15.879713 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:15.880175 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:15.880603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:16.100989 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:16.109917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:16.110962 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f6f4e44f-702f-4b86-99d6-85dc4167237d tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.245170 Oct 10 12:17:16.111584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 520/987] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:15 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:16.118129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-90739db2-1b43-420f-be99-cee1525fc5db tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.263375 Oct 10 12:17:16.118743 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 468/988] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:15 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:17.134436 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:17.135285 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:17.141619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:17.142227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:17.143364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:17.144161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:17.144714 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:17.145523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:17.146296 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:17.146867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:17.149693 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:17.150378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:17.150861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:17.152100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:17.152583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:17.153150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:17.430374 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:17.434754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:17.446836 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bc5e1950-b278-4c9f-90aa-b4ecf7e64eef tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.315768 Oct 10 12:17:17.449085 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 521/989] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:17 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:17.450802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-06b080c2-a8dc-4741-a620-f3ea20b2c16b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1266 microversion: 2.1 time: 0.312732 Oct 10 12:17:17.459428 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 469/990] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:17 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:18.472227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:18.473018 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:18.480826 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:18.481100 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:18.481906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:18.482930 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:18.483593 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:18.484183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:18.493699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:18.494468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:18.504930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:18.505921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:18.506696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:18.507630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:18.508283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:18.508915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:18.809334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:18.817516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-57533aed-9552-4b49-8cc2-866ec1b0ed79 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1454 microversion: 2.1 time: 0.332139 Oct 10 12:17:18.818359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 470/991] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:18 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1454 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:18.820402 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:18.823140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-94a5fd51-6ee1-43ca-944b-ca5d1a15a87c req-9f469487-ece4-4eac-bc1e-e68b2b03b499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e7774e-b8b3-4e69-967d-c19741018ddf", "name": "network-vif-plugged", "status": "completed", "tag": "1837ddef-a7eb-4bd3-b4f5-a127aa82e594"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:17:18.833588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-94a5fd51-6ee1-43ca-944b-ca5d1a15a87c req-9f469487-ece4-4eac-bc1e-e68b2b03b499 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:18.834333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-94a5fd51-6ee1-43ca-944b-ca5d1a15a87c req-9f469487-ece4-4eac-bc1e-e68b2b03b499 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:18.838828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-94a5fd51-6ee1-43ca-944b-ca5d1a15a87c req-9f469487-ece4-4eac-bc1e-e68b2b03b499 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:18.839039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c6af3ae3-a004-44f6-a2c9-dcfd9301da55 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.367290 Oct 10 12:17:18.839039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 522/992] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:18 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:18.845906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:18.847289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:18.851094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-94a5fd51-6ee1-43ca-944b-ca5d1a15a87c req-9f469487-ece4-4eac-bc1e-e68b2b03b499 service nova] Creating event network-vif-plugged:1837ddef-a7eb-4bd3-b4f5-a127aa82e594 for instance b5e7774e-b8b3-4e69-967d-c19741018ddf on hv-cinder-86020 Oct 10 12:17:18.854092 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:18.854588 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:18.855092 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:18.855848 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:18.856321 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:18.856778 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-94a5fd51-6ee1-43ca-944b-ca5d1a15a87c req-9f469487-ece4-4eac-bc1e-e68b2b03b499 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037239 Oct 10 12:17:18.856960 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:18.857589 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 471/993] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:17:19.024835 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:19.033398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-368ee66a-96f9-4faf-a35a-01e887507d8f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1454 microversion: 2.1 time: 0.194447 Oct 10 12:17:19.033999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 523/994] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:18 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:19.864393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:19.865153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:19.872767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:19.873148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:19.873794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:19.874509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:19.875604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:19.877607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:20.067018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:20.080072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-010bc5f9-ed7a-46c8-b32e-fea9b8eaf8d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.219673 Oct 10 12:17:20.080746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 472/995] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:19 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:17:21.109260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:21.110318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:21.120582 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:21.123161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:21.123161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:21.123161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:21.123941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:21.124661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:21.306760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:21.315258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b1a84be2-0621-4537-be7e-b23ff0df0fc2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1363 microversion: 2.1 time: 0.213956 Oct 10 12:17:21.316327 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 524/996] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:21 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:21.401187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-b8e0e9d9-2c1f-4868-8a97-f0933852c014 req-26d402e1-ac20-494b-ba46-9057c6e896c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25", "tag": "7ba57a2d-ce5e-46be-bfeb-ce6690c962c7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:17:21.413736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-b8e0e9d9-2c1f-4868-8a97-f0933852c014 req-26d402e1-ac20-494b-ba46-9057c6e896c2 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:21.414634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-b8e0e9d9-2c1f-4868-8a97-f0933852c014 req-26d402e1-ac20-494b-ba46-9057c6e896c2 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:21.415195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-b8e0e9d9-2c1f-4868-8a97-f0933852c014 req-26d402e1-ac20-494b-ba46-9057c6e896c2 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:21.429985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-b8e0e9d9-2c1f-4868-8a97-f0933852c014 req-26d402e1-ac20-494b-ba46-9057c6e896c2 service nova] Creating event network-changed:7ba57a2d-ce5e-46be-bfeb-ce6690c962c7 for instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 on hv-cinder-86020 Oct 10 12:17:21.436740 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-b8e0e9d9-2c1f-4868-8a97-f0933852c014 req-26d402e1-ac20-494b-ba46-9057c6e896c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040889 Oct 10 12:17:21.437482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 473/997] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:17:22.342979 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:22.343674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:22.350830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:22.351553 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:22.352240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:22.353221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:22.353803 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:22.354480 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:22.528379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:17:22.540579 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8a9416ae-18a7-4f09-b01f-9b4811002e0e tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1547 microversion: 2.1 time: 0.203370 Oct 10 12:17:22.541223 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 525/998] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:17:22 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1547 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:17:22.567385 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:17:22.567988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:17:22.570114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=78 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:22.576102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:22.578120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:22.578120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:22.578120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:22.578120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:22.578541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:22.665034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ec495b5a-d42c-46dc-8d51-8791530aa82f tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104024 Oct 10 12:17:22.667625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 474/999] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:17:22 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:17:23.987398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-0a3eda6b-2e3b-48ef-8820-a5f3dedcb39f req-4e8d79ce-ed33-449f-adb9-92f1e6d33804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e7774e-b8b3-4e69-967d-c19741018ddf", "tag": "1837ddef-a7eb-4bd3-b4f5-a127aa82e594"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:17:23.998334 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0a3eda6b-2e3b-48ef-8820-a5f3dedcb39f req-4e8d79ce-ed33-449f-adb9-92f1e6d33804 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:17:23.999025 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0a3eda6b-2e3b-48ef-8820-a5f3dedcb39f req-4e8d79ce-ed33-449f-adb9-92f1e6d33804 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:17:23.999569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-0a3eda6b-2e3b-48ef-8820-a5f3dedcb39f req-4e8d79ce-ed33-449f-adb9-92f1e6d33804 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:17:24.012676 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-0a3eda6b-2e3b-48ef-8820-a5f3dedcb39f req-4e8d79ce-ed33-449f-adb9-92f1e6d33804 service nova] Creating event network-changed:1837ddef-a7eb-4bd3-b4f5-a127aa82e594 for instance b5e7774e-b8b3-4e69-967d-c19741018ddf on hv-cinder-86020 Oct 10 12:17:24.018600 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-0a3eda6b-2e3b-48ef-8820-a5f3dedcb39f req-4e8d79ce-ed33-449f-adb9-92f1e6d33804 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037182 Oct 10 12:17:24.022259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 526/1000] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:18:19.000945 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=39 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:19.002178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:18:19.002330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Mon Oct 10 12:18:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/ips (ip 10.222.0.46) !!! Oct 10 12:18:19.212487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:19.213082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:19.219567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:19.220058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:19.220494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:19.221185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:19.221651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:19.222106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:19.246949 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-26dc86ef-202b-4f19-8bbc-47cb52eef474 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/ips" status: 200 len: 150 microversion: 2.1 time: 0.247957 Oct 10 12:18:19.247524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 475/1001] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:18:18 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/ips => generated 150 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:18:22.912931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52ea4e11-f376-43bb-a731-b25a6adacdd9"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:18:22.915540 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:22.917970 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=43 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:22.918625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=51 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:22.919754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:18:22.919899 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments (ip 10.222.0.46) !!! Oct 10 12:18:22.926115 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:22.926598 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:22.927055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:22.927752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:22.928204 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:22.928625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:23.731994 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-42d4ffc8-778b-46b8-8581-489e721c9190 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823268 Oct 10 12:18:23.732622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 527/1002] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:18:22 2022] POST /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:18:26.866943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:26.867696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:26.874112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:26.874595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:26.875065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:26.875767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:26.876223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:26.876651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:26.900284 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4e33737a-1574-48ed-853d-e275c8c072dd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/ips" status: 200 len: 152 microversion: 2.20 time: 0.180585 Oct 10 12:18:26.900855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 476/1003] 10.222.0.46 () {60 vars in 1289 bytes} [Mon Oct 10 12:18:26 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/ips => generated 152 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 12:18:30.094324 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:18:30.095740 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:30.102423 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:30.103217 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:30.103661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:30.104678 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:30.104820 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:30.105222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:30.132143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lazy-loading 'flavor' on Instance uuid 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:18:30.602892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-76f1d2fe-1952-425c-ba44-2d51289f9626 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/action" status: 202 len: 0 microversion: 2.20 time: 0.514705 Oct 10 12:18:30.603691 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 528/1004] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 10 12:18:30 2022] POST /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:18:30.612965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:30.614284 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:30.620732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:30.621304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:30.621713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:30.622585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:30.623095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:30.623641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:30.870954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:30.880961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:30.882455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:30.883684 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e46c07ff-d049-4938-8c7f-c9d761803fbd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.275605 Oct 10 12:18:30.884253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 477/1005] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:30 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:31.911060 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:31.911759 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:31.920576 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:31.921068 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:31.921533 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:31.922235 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:31.922719 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:31.923154 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:32.054527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:32.062986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:32.064429 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:32.065604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9094af71-30eb-4df5-97b0-f393c313d99d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.159439 Oct 10 12:18:32.066166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 529/1006] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:31 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:18:33.092493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:33.093139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:33.099721 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:33.100209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:33.100650 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:33.101352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:33.101810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:33.102239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:33.241381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:33.256494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:33.258054 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:33.259301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-88fdf84e-ac9f-4844-8ee4-c8054f43c5f0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.171517 Oct 10 12:18:33.259870 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 478/1007] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:33 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:34.284813 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:34.285419 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:34.292439 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:34.292923 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:34.293364 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:34.294062 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:34.294516 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:34.295470 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:34.447905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:34.458342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:34.460310 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:34.461814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a3a6f69b-e0d8-4ea8-b004-6cb0acf35cef tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.180920 Oct 10 12:18:34.463456 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 530/1008] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:34 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:35.489652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:35.490457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:35.497170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:35.498356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:35.499041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:35.499457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:35.499908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:35.500329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:35.633960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:35.643009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:35.644448 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:35.645616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-93984b5c-a644-40da-a66f-6ba5970cd44c tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.160264 Oct 10 12:18:35.646183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 479/1009] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:35 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:36.670972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:36.671591 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:36.678207 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:36.678721 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:36.679169 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:36.679875 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:36.680335 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:36.680768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:36.820619 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:36.829042 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:36.830437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:36.831594 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ead16c8d-a201-4f89-a6ef-dfdda3bd1efc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.164666 Oct 10 12:18:36.832161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 531/1010] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:36 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:37.652343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52ea4e11-f376-43bb-a731-b25a6adacdd9"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:18:37.654933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:37.661732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:37.662224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:37.662656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:37.663424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:37.663879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:37.664304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:37.747515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Invalid volume: volume 52ea4e11-f376-43bb-a731-b25a6adacdd9 is already attached to instances: 1476dd01-f830-450e-a00a-4e4c54345b44 Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: POST /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments HTTP/1.1 Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 74 Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:18:37.749829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {"volumeAttachment": {"volumeId": "52ea4e11-f376-43bb-a731-b25a6adacdd9"}} Oct 10 12:18:37.754438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Invalid volume: volume 52ea4e11-f376-43bb-a731-b25a6adacdd9 is already attached to instances: 1476dd01-f830-450e-a00a-4e4c54345b44 Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'server_id': '1476dd01-f830-450e-a00a-4e4c54345b44', 'body': {'volumeAttachment': {'volumeId': '52ea4e11-f376-43bb-a731-b25a6adacdd9'}}} Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 52ea4e11-f376-43bb-a731-b25a6adacdd9 is already attached to instances: 1476dd01-f830-450e-a00a-4e4c54345b44 Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:37.755389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 52ea4e11-f376-43bb-a731-b25a6adacdd9 is already attached to instances: 1476dd01-f830-450e-a00a-4e4c54345b44 Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:18:37.756756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 52ea4e11-f376-43bb-a731-b25a6adacdd9 is already attached to instances: 1476dd01-f830-450e-a00a-4e4c54345b44 Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 400 to user: Invalid volume: volume 52ea4e11-f376-43bb-a731-b25a6adacdd9 is already attached to instances: 1476dd01-f830-450e-a00a-4e4c54345b44 {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e79cd3eb-66ea-4dc1-976b-0884076f748d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103207 Oct 10 12:18:37.758251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 480/1011] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:18:37 2022] POST /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:18:37.818214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:37.818785 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:37.825546 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:37.826687 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:37.827209 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:37.828010 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:37.828528 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:37.828963 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:37.857554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:37.858339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:37.865606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:37.866046 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:37.866457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:37.867258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:37.867809 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:37.868239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:37.918406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'services' on Instance uuid 1476dd01-f830-450e-a00a-4e4c54345b44 {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:18:38.003925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:38.012874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:38.014351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:38.015592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6ee232d6-c085-4572-9c76-f8f4642b5ded tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.162157 Oct 10 12:18:38.016153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 481/1012] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:37 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:18:38.179700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3b25fc7c-2fe2-4952-a453-c9709f185d88 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments/52ea4e11-f376-43bb-a731-b25a6adacdd9" status: 202 len: 0 microversion: 2.1 time: 0.365306 Oct 10 12:18:38.180325 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 532/1013] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:18:37 2022] DELETE /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments/52ea4e11-f376-43bb-a731-b25a6adacdd9 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:18:38.189606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:38.191919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:38.197933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:38.200107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:38.200107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:38.200107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:38.200107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:38.200518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:38.230514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e917f40c-ae5d-4474-94cc-dbdf49359cfc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Oct 10 12:18:38.231114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 482/1014] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:18:38 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:18:39.041645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:39.042341 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:39.049972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:39.050451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:39.050910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:39.051612 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:39.052062 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:39.052485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:39.189761 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:39.197884 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:39.199345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:39.203013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-aca5c89e-8a80-4102-85a2-11777a44f5cf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.163203 Oct 10 12:18:39.203013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 533/1015] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:39 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:39.243036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:39.245134 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:39.251946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:39.252414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:39.252861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:39.253578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:39.254036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:39.254465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:39.287547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-42fae7bc-d82a-4e30-ade9-31565ab004ae tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048598 Oct 10 12:18:39.288325 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 483/1016] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:18:39 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:18:40.227461 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:40.228065 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:40.235139 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.235625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.236061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.236758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.237213 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.237636 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.301025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:40.303451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:40.310104 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.311178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.311649 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.312397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.312888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.313290 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.347158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-468fec2a-d73e-44f8-9422-72280acbee19 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050087 Oct 10 12:18:40.348067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 484/1017] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:18:40 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 12:18:40.380352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:40.389050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:40.394132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:40.394132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-808d5b31-9580-4582-b927-253de4fb8dd4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.168239 Oct 10 12:18:40.394132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 534/1018] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:40 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:40.415492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:40.416153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:40.422979 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.423462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.423891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.424582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.425033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.425682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.459176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:18:40.813041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-903f21f4-347b-46fa-b77a-63c206b2eb97 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 204 len: 0 microversion: 2.1 time: 0.401202 Oct 10 12:18:40.813633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 485/1019] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:18:40 2022] DELETE /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:18:40.822604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:40.823271 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:40.830831 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.831325 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.831773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.832486 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:40.832938 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:40.833443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:40.972683 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:40.980731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-69115d8e-a615-4022-97f2-6bacf4805a36 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1681 microversion: 2.1 time: 0.162374 Oct 10 12:18:40.981316 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 535/1020] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:40 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:41.418165 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:41.419098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:41.425692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:41.426177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:41.426650 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:41.427444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:41.427957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:41.428389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:41.563834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:41.572146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:41.573668 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:41.574902 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dbc55f5b-52a2-4dd0-9cc0-56a74217703a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.161147 Oct 10 12:18:41.575491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 486/1021] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:41 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:42.005116 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:42.005976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:42.013459 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:42.013966 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:42.014414 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:42.015173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:42.015632 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:42.016063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:42.154396 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:42.162367 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5f604bb6-8dd1-4e64-89c2-fcb23fadac5d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1681 microversion: 2.1 time: 0.161312 Oct 10 12:18:42.162978 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 536/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:41 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:42.601654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:42.602309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:42.609088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:42.609622 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:42.610025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:42.610769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:42.611231 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:42.611666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:42.756838 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:42.765699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:42.767189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:42.768432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e9c94336-6c02-4d92-abea-ce34302b66c2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.170863 Oct 10 12:18:42.769006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 487/1023] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:42 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:43.185850 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:43.186478 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:43.193256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:43.193747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:43.194228 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:43.194976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:43.195432 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:43.195868 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:43.336704 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:43.350800 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ce526720-9ddb-4206-a07e-5387f633faf2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1681 microversion: 2.1 time: 0.168549 Oct 10 12:18:43.351838 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 537/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:43 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:43.795152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:43.795853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:43.802536 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:43.803058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:43.803494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:43.804207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:43.804666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:43.805095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:43.950025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:43.959598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:43.961053 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:43.962264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-db78a433-0b6e-4793-8c46-1258ac20617a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.172495 Oct 10 12:18:43.962882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 488/1025] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:43 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:44.374764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:44.375374 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:44.382750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:44.383253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:44.383698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:44.384416 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:44.384872 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:44.385305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:44.557561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:44.566579 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-286faf08-db1f-44ce-ad72-d11d26f13919 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1681 microversion: 2.1 time: 0.196712 Oct 10 12:18:44.571227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 538/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:44 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:44.990232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:44.990905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:44.998504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:44.999029 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:44.999471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:45.000201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:45.000683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:45.001084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:45.149033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:45.158414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:45.159898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:45.161074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5063e42b-2d13-48e2-b6be-19a448fef97b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.175866 Oct 10 12:18:45.161640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 489/1027] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:44 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:45.607113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:45.607735 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:45.614603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:45.615128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:45.615603 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:45.616328 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:45.616780 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:45.617211 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:45.638738 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:45.776802 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:45.785570 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-9049cc2d-eae4-4abc-81fe-f6745a1a4257 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1681 microversion: 2.1 time: 0.182253 Oct 10 12:18:45.786161 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 539/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:45 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:46.187097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:46.187724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:46.194732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:46.195225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:46.195672 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:46.196682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:46.197153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:46.197703 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:46.218741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:46.351031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:46.365102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:46.368019 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:46.368545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e99baeb4-6017-4468-987d-cdf806e8c7aa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.185731 Oct 10 12:18:46.369279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 490/1029] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:46 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:46.676971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-2bb4c6bf-77ac-4ffb-88ea-daff7534790a req-8349da8d-dbe2-4852-8cbe-99fbe128d391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1476dd01-f830-450e-a00a-4e4c54345b44", "name": "network-vif-deleted", "tag": "07d8609f-409c-413a-b79d-ca897650173a"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:18:46.689538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-2bb4c6bf-77ac-4ffb-88ea-daff7534790a req-8349da8d-dbe2-4852-8cbe-99fbe128d391 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:46.694914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-2bb4c6bf-77ac-4ffb-88ea-daff7534790a req-8349da8d-dbe2-4852-8cbe-99fbe128d391 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:46.694914 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-2bb4c6bf-77ac-4ffb-88ea-daff7534790a req-8349da8d-dbe2-4852-8cbe-99fbe128d391 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:46.705499 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-2bb4c6bf-77ac-4ffb-88ea-daff7534790a req-8349da8d-dbe2-4852-8cbe-99fbe128d391 service nova] Creating event network-vif-deleted:07d8609f-409c-413a-b79d-ca897650173a for instance 1476dd01-f830-450e-a00a-4e4c54345b44 on hv-cinder-86020 Oct 10 12:18:46.711497 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-2bb4c6bf-77ac-4ffb-88ea-daff7534790a req-8349da8d-dbe2-4852-8cbe-99fbe128d391 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038196 Oct 10 12:18:46.713120 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 540/1030] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:18:46.815065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:46.816306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:46.829062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:46.830437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:46.830437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:46.830954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:46.831431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:46.831869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:46.905698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:46.915599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-20cf7cb6-7954-4cb7-a910-4ab996b8a680 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1614 microversion: 2.1 time: 0.109221 Oct 10 12:18:46.923847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 491/1031] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:46 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:47.401016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:47.401752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:47.408785 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:47.409352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:47.409890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:47.410736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:47.411264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:47.411762 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:47.568597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:47.579338 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:47.580844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:47.590464 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-383cce79-9b61-45b3-8912-ccdee390bee4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.185779 Oct 10 12:18:47.590464 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 541/1032] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:47 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:47.942547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:47.943121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:47.949840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:47.950330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:47.950844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:47.951556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:47.952011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:47.952439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:47.986109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:47.986610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:47.987080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:47.987536 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid 1476dd01-f830-450e-a00a-4e4c54345b44 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:18:48.039417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:48.048254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0e232f7d-d4eb-4f3e-94da-59b304454391 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1331 microversion: 2.1 time: 0.109805 Oct 10 12:18:48.048851 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 492/1033] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:47 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:18:48.608970 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:48.609583 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:48.616371 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:48.616860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:48.617303 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:48.618047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:48.618504 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:48.618958 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:48.756780 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:48.766033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:48.767666 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:48.768869 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ea926f83-a6da-402d-bf9c-4701e73e2b82 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.164101 Oct 10 12:18:48.769451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 542/1034] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:48 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:49.072147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:49.072707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:49.075142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:49.080020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:49.080545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:49.080987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:49.081698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:49.082158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:49.082589 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:49.118515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:49.119056 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:49.119492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:49.119935 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid 1476dd01-f830-450e-a00a-4e4c54345b44 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:18:49.160728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:49.168876 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5b78098a-ca12-464c-94df-5317367b1655 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1331 microversion: 2.1 time: 0.100806 Oct 10 12:18:49.170052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 493/1035] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:49 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:49.799320 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:49.799908 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:49.807114 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:49.807606 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:49.808050 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:49.808764 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:49.809222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:49.809699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:49.955316 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:49.964210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:49.965915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:49.967793 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-23563266-95fc-4852-bf1a-25c8f8567473 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.174109 Oct 10 12:18:49.968370 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 543/1036] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:49 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:50.192661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:50.193462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:50.201105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:50.201599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:50.202044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:50.202803 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:50.203257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:50.203697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:50.239362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:50.239855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:50.240301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:50.240761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid 1476dd01-f830-450e-a00a-4e4c54345b44 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:18:50.287731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:50.296016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-932add29-b8e5-4047-8349-51a8cfa182ac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1331 microversion: 2.1 time: 0.107480 Oct 10 12:18:50.296624 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 494/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:50 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:50.993663 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:50.994437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:51.002768 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:51.003256 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:51.003690 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:51.004384 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:51.004832 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:51.005250 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:51.158536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:51.167905 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:51.169993 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:51.171246 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-28268274-1671-4bce-9040-ee0f5ad5b696 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.181641 Oct 10 12:18:51.171826 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 544/1038] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:50 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:51.322012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:51.322630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:51.330490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:51.331076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:51.331514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:51.332217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:51.332664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:51.333085 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:51.369049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:51.369535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:51.369988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:51.370505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid 1476dd01-f830-450e-a00a-4e4c54345b44 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:18:51.413868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:51.423012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-160401e0-b6ba-4a27-a443-113b26526b6f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 200 len: 1331 microversion: 2.1 time: 0.105333 Oct 10 12:18:51.423612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 495/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:51 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:52.200139 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:52.201372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:52.208854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:52.209492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:52.210051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:52.210906 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:52.211488 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:52.212013 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:52.367346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:52.377390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:52.378879 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:52.380083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-6a116509-2de5-452c-a743-56224e782a29 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.184436 Oct 10 12:18:52.380649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 545/1040] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:52 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:18:52.453466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:52.454062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:52.460960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:52.461452 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:52.461896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:52.462617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:52.463100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:52.463542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:52.479816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 HTTP/1.1 Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:18:52.482075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:18:52.483572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '1476dd01-f830-450e-a00a-4e4c54345b44'} Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:18:52.484344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:18:52.485841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:18:52.490504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:18:52.490504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-41012e50-2070-470d-ba67-ab3ad1481365 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 404 len: 111 microversion: 2.1 time: 0.034233 Oct 10 12:18:52.490504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 496/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:52 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:18:52.498262 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ce0eb68e-cee0-4e32-b102-7ef048e5c0ff tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '.version_select at 0x7f6d12b48dc0>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:52.626468 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ce0eb68e-cee0-4e32-b102-7ef048e5c0ff tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067962079" status: 202 len: 0 microversion: 2.1 time: 0.132308 Oct 10 12:18:52.627532 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 546/1042] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 10 12:18:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067962079 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:18:53.406934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:53.407572 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:53.414648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:53.415724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:53.415724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:53.416302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:53.416755 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:53.417192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:53.594651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:53.615569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:53.620139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:53.623831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-83b03ce4-2708-4ef4-9937-a887b29e2d85 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1745 microversion: 2.20 time: 0.220425 Oct 10 12:18:53.624695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 497/1043] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:53 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:53.642227 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d66436ed-0ac7-48bb-a5ae-9460cfdc2888 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: .version_select at 0x7f6d1287e040>, body: {"keypair": {"name": "tempest-keypair-1763038858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZaWyNKln3hC8mgjvY7liMEZB9+yxbfvnWCUBB60Wwqo81iDrxsU0HNfjPtGducnSJVMpt7sGU0bkcaQfS1ds5D5jwM/LD6YA08jvkCiPDQJVHh8yjPQk1NngLMBGirgg=="}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:18:53.655389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:53.674597 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-d66436ed-0ac7-48bb-a5ae-9460cfdc2888 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:18:53.682496 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-d66436ed-0ac7-48bb-a5ae-9460cfdc2888 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:18:53.805777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d66436ed-0ac7-48bb-a5ae-9460cfdc2888 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172582 Oct 10 12:18:53.806727 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 547/1044] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:18:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:18:54.663991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:54.664841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:54.672159 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:54.672651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:54.673089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:54.673806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:54.674262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:54.674716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:54.826213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:54.836279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:54.838025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:54.839177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-74b2503d-2d95-408d-96bf-2e4d15cab843 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1745 microversion: 2.20 time: 0.179270 Oct 10 12:18:54.840093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 498/1045] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:54 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:55.870139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:55.873000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:55.888432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:55.889929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:55.889929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:55.890985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:55.891829 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:55.892671 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:55.909996 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-d6d48fc4-5f31-430e-bdc4-736e62beb7ec req-1160dd04-2136-4bf4-bff3-e2d8f90b6bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b", "name": "network-vif-plugged", "status": "completed", "tag": "d904bf77-5a1e-4848-a3d8-d43e634f0c09"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:18:55.923463 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-d6d48fc4-5f31-430e-bdc4-736e62beb7ec req-1160dd04-2136-4bf4-bff3-e2d8f90b6bfe service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:55.924441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-d6d48fc4-5f31-430e-bdc4-736e62beb7ec req-1160dd04-2136-4bf4-bff3-e2d8f90b6bfe service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:55.925058 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-d6d48fc4-5f31-430e-bdc4-736e62beb7ec req-1160dd04-2136-4bf4-bff3-e2d8f90b6bfe service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:55.947550 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-d6d48fc4-5f31-430e-bdc4-736e62beb7ec req-1160dd04-2136-4bf4-bff3-e2d8f90b6bfe service nova] Creating event network-vif-plugged:d904bf77-5a1e-4848-a3d8-d43e634f0c09 for instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b on hv-cinder-86020 Oct 10 12:18:55.955788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-d6d48fc4-5f31-430e-bdc4-736e62beb7ec req-1160dd04-2136-4bf4-bff3-e2d8f90b6bfe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136316 Oct 10 12:18:55.957752 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 548/1046] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:18:56.205113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:56.225105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:56.228514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:56.239666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e84b48c9-80fc-435b-95a1-2085d2c2c639 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1745 microversion: 2.20 time: 0.367794 Oct 10 12:18:56.239666 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 499/1047] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:55 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:18:56.729645 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1754265726", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f74af49-8f08-437e-8de8-52cf94d07154"}], "security_groups": [{"name": "tempest-securitygroup--2013511250"}], "key_name": "tempest-keypair-1763038858", "user_data": "}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:18:56.846641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] validate_networks() for [('3f74af49-8f08-437e-8de8-52cf94d07154', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:18:57.276765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:57.277359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:57.285840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:57.285840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:57.285840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:57.286347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:57.286835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:57.287266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:57.347887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:18:57.348689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image limits 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:18:57.349539 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Flavor pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:18:57.350253 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Image pref 0:0:0 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:18:57.350916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.virt.hardware [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121298) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:18:57.366458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:57.371260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:57.371260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:57.371260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:57.371260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:57.371997 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:57.389439 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:18:57.394325 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Getting quotas for user fef422264d0c4a43a0aa1b9eff2251bd and project aab51c9b019e400c8e28d9a789eda6da. Resources: {'cores', 'instances', 'ram'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:18:57.407975 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Going to run 1 instances... {{(pid=121298) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:18:57.410459 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121298) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:18:57.463326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:57.474592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:57.476071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:57.477310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bac85a70-3479-45ac-a9fa-eede93a152e9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1745 microversion: 2.20 time: 0.205758 Oct 10 12:18:57.477869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 500/1048] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:57 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1745 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:18:57.580229 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c48ed02c-3b0b-4a2e-9408-b4bd5910072e tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.854891 Oct 10 12:18:57.581665 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 549/1049] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:18:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:18:57.603612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-46baf976-a35c-468a-970b-1b8e4e9b7e4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:57.610603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-46baf976-a35c-468a-970b-1b8e4e9b7e4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:57.706823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-46baf976-a35c-468a-970b-1b8e4e9b7e4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:57.714551 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-46baf976-a35c-468a-970b-1b8e4e9b7e4b tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1242 microversion: 2.1 time: 0.118753 Oct 10 12:18:57.715306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 501/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:57 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:58.514277 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:58.514938 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:58.522741 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:58.523239 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:58.523682 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:58.524432 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:58.524890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:58.525358 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:58.697083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:58.705696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:58.707221 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:58.708383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-824cc47e-188e-40e0-868c-f6a5dc0aeb74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1745 microversion: 2.20 time: 0.199449 Oct 10 12:18:58.708931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 550/1051] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:58 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1745 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:58.740711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-173aa7a8-294b-4ac5-9f3e-3318152e0967 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:58.741309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-173aa7a8-294b-4ac5-9f3e-3318152e0967 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:58.799786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-173aa7a8-294b-4ac5-9f3e-3318152e0967 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:58.809279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-173aa7a8-294b-4ac5-9f3e-3318152e0967 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1242 microversion: 2.1 time: 0.072304 Oct 10 12:18:58.810357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 502/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:58 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:18:59.736277 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:59.736935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:59.744154 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:59.744666 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:59.745109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:59.745809 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:59.746286 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:59.746777 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:59.843475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:18:59.844098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:18:59.851153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:59.852119 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:59.852563 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:59.853277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:18:59.853737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:18:59.854164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:18:59.898750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:59.907749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:59.909197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:59.915731 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-980540c0-351d-42e0-95db-3b8586e52500 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1745 microversion: 2.20 time: 0.178936 Oct 10 12:18:59.927894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:18:59.931105 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 551/1053] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:18:59 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:18:59.936858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-211bc9bb-a4e0-4935-b5e9-ae3360dffa65 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1294 microversion: 2.1 time: 0.097738 Oct 10 12:18:59.937509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 503/1054] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:18:59 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:00.938915 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:00.939534 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:00.946438 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:00.946999 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:00.947479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:00.948280 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:00.948890 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:00.949340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:00.967885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:00.968587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:00.980048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:00.981366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:00.982021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:00.983650 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:00.984461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:00.987502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:01.106103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:01.118710 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0509f6e2-30f9-4401-b3b5-0aeca805e178 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1312 microversion: 2.1 time: 0.156893 Oct 10 12:19:01.121178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 504/1055] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:00 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:01.177776 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:01.188187 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:01.189653 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:01.191440 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fd353509-8e33-480b-a8c1-647eed01e50d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.257323 Oct 10 12:19:01.192733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 552/1056] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:00 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:02.145016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:02.148315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:02.176824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:02.181977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:02.186719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:02.188095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:02.189910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:02.190545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:02.219812 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:02.220929 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:02.233867 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:02.235330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:02.236380 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:02.238152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:02.239667 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:02.240138 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:02.474617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:02.489622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:02.491473 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:02.495044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d8e0dc21-7e9f-4002-ba34-ba89c625c884 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.280175 Oct 10 12:19:02.496878 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 553/1057] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:02 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:02.528793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:02.539574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cbf06bbb-e994-49f0-953d-b78b7cfad991 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.399527 Oct 10 12:19:02.541754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 505/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:02 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:19:03.409303 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-a6bb388e-b916-4bb5-83af-4bc22beeb722 req-16f4fd06-b819-4625-b349-3adf873faf36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca601f1-e5dc-43b0-91ee-16f03eefb50a", "tag": "f452dd9a-f82f-4a66-84ef-1b78de8cce04"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:03.462538 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-a6bb388e-b916-4bb5-83af-4bc22beeb722 req-16f4fd06-b819-4625-b349-3adf873faf36 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:03.467117 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-a6bb388e-b916-4bb5-83af-4bc22beeb722 req-16f4fd06-b819-4625-b349-3adf873faf36 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:03.470522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-a6bb388e-b916-4bb5-83af-4bc22beeb722 req-16f4fd06-b819-4625-b349-3adf873faf36 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:03.515113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-a6bb388e-b916-4bb5-83af-4bc22beeb722 req-16f4fd06-b819-4625-b349-3adf873faf36 service nova] Creating event network-changed:f452dd9a-f82f-4a66-84ef-1b78de8cce04 for instance eca601f1-e5dc-43b0-91ee-16f03eefb50a on hv-cinder-86020 Oct 10 12:19:03.527629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:03.535738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:03.546264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-a6bb388e-b916-4bb5-83af-4bc22beeb722 req-16f4fd06-b819-4625-b349-3adf873faf36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145551 Oct 10 12:19:03.548770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:03.550071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:03.550248 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 554/1059] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:03.551320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:03.552814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:03.553941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:03.558231 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:03.567506 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:03.568089 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:03.585830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:03.586207 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:03.586523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:03.587457 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:03.588066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:03.590412 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:03.837346 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:03.856297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:03.856297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:03.856297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b2abf44f-c823-429e-8329-955adbf08931 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.337362 Oct 10 12:19:03.858989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 506/1060] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:03 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:03.881575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:03.896910 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-ae1444b7-4368-4895-b284-e326d1c6f7f2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.333923 Oct 10 12:19:03.898023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 555/1061] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:03 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:04.888367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:04.890291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:04.898210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:04.899112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:04.900049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:04.901279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:04.902141 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:04.903133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:04.932130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:04.932985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:04.966037 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:04.966525 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:04.967744 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:04.970977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:04.971696 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:04.979631 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:05.094612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:05.127010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:05.131506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:05.135849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e5d14828-6d6b-407f-b7c1-f4114cc00aaf tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.251769 Oct 10 12:19:05.137625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 507/1062] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:04 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:05.279476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:05.291066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-732fa858-5031-4fb6-af97-45d6853a4c95 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.373583 Oct 10 12:19:05.291658 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 556/1063] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:04 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:19:06.189195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:06.189797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:06.197135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:06.215190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:06.215947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:06.216932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:06.218200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:06.218513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:06.274869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:06.318476 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:06.320046 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:06.329695 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:06.330833 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:06.331672 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:06.332861 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:06.333717 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:06.334754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:06.542180 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:06.565207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:06.566996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:06.568218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3bb32912-774e-4823-b816-335e98a4a0c4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.384858 Oct 10 12:19:06.568983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 508/1064] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:06 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:06.592372 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:06.606400 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-730ae624-d1d1-49ec-88de-5ef27b60e1f7 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.293474 Oct 10 12:19:06.607884 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 557/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:06 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:07.613196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:07.614419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:07.627330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:07.631475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:07.632737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:07.634916 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:07.636331 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:07.637679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:07.649286 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:07.658385 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:07.671705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:07.685093 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=10 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:07.724523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:07.726846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:07.727625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:07.729128 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:07.730202 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:07.731106 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:08.001569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:08.011520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:08.017853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:08.017853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-65cc38b7-28b0-46dd-ac9f-4d85daf3ff27 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.407140 Oct 10 12:19:08.017853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 509/1066] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:07 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:08.048272 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:08.057201 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a1161ea5-cafb-42b1-b944-e74588de0a70 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.424869 Oct 10 12:19:08.067624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 558/1067] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:07 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:19:09.051518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:09.052565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:09.055321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=4 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:09.063708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:09.064344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:09.064882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:09.065936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:09.066417 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:09.066907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:09.084819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:09.086152 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:09.108397 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:09.108888 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:09.109342 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:09.110085 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:09.110544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:09.111011 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:09.342975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:09.350604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:09.353218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:09.354985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:09.356507 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-822bdbdc-0c42-48c2-8d3d-5a8b338f3836 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.313156 Oct 10 12:19:09.357910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 510/1068] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:09 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:09.373575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e2b41681-065f-48ae-8fe4-3cb5c351cb2a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.292963 Oct 10 12:19:09.374485 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 559/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:09 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:10.225805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-1b4f9cff-175a-4dbd-ab85-d90052aa8be9 req-9953cbc8-70a2-4d9e-9878-69c0a5920549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca601f1-e5dc-43b0-91ee-16f03eefb50a", "name": "network-vif-plugged", "status": "completed", "tag": "f452dd9a-f82f-4a66-84ef-1b78de8cce04"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:10.242718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-1b4f9cff-175a-4dbd-ab85-d90052aa8be9 req-9953cbc8-70a2-4d9e-9878-69c0a5920549 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:10.253114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-1b4f9cff-175a-4dbd-ab85-d90052aa8be9 req-9953cbc8-70a2-4d9e-9878-69c0a5920549 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:10.253114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-1b4f9cff-175a-4dbd-ab85-d90052aa8be9 req-9953cbc8-70a2-4d9e-9878-69c0a5920549 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:10.264929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-1b4f9cff-175a-4dbd-ab85-d90052aa8be9 req-9953cbc8-70a2-4d9e-9878-69c0a5920549 service nova] Creating event network-vif-plugged:f452dd9a-f82f-4a66-84ef-1b78de8cce04 for instance eca601f1-e5dc-43b0-91ee-16f03eefb50a on hv-cinder-86020 Oct 10 12:19:10.278053 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-1b4f9cff-175a-4dbd-ab85-d90052aa8be9 req-9953cbc8-70a2-4d9e-9878-69c0a5920549 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062204 Oct 10 12:19:10.278053 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 511/1070] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:10.384808 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:10.385604 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:10.393935 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:10.394790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:10.395422 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:10.396419 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:10.397209 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:10.397641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:10.405520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:10.406422 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:10.423022 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:10.423872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:10.424492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:10.426042 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:10.426799 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:10.427400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:10.682265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:10.685946 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:10.692927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:10.695273 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:10.697750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-5e9cabb9-5fdb-43bf-98a5-012943c3c06e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.317884 Oct 10 12:19:10.717105 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 560/1071] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:10 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:10.775916 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:10.784758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e09bd074-d7dc-4c2e-8154-19ae7838f9e3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.391072 Oct 10 12:19:10.785580 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 512/1072] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:10 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:11.725340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:11.726695 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:11.734387 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:11.735352 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:11.736102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:11.736794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:11.737311 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:11.738171 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:11.810074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:11.811440 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:11.822143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:11.822748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:11.823259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:11.823971 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:11.824557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:11.825181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:11.984571 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:11.994014 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:11.995949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:11.997542 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-02064221-180a-4f90-88eb-6f872c966922 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.276530 Oct 10 12:19:12.000061 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 561/1073] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:11 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:12.078915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:12.088400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fcfd57c0-5662-45d2-9e95-c7a70d3d5e23 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1368 microversion: 2.1 time: 0.282848 Oct 10 12:19:12.089015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 513/1074] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:11 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:13.031207 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:13.031870 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:13.039143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:13.040292 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:13.040733 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:13.041522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:13.041982 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:13.042405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:13.113197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:13.113974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:13.129379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:13.129379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:13.129951 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:13.130826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:13.133263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:13.137227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:13.298862 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:13.309814 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:13.312949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:13.315362 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-97148f0a-3abe-44a5-a405-41bb4de508f7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.289162 Oct 10 12:19:13.316491 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 562/1075] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:13 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:13.351557 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:13.359709 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3614497b-d3e7-4c16-aabe-84be18dfcf15 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1558 microversion: 2.1 time: 0.251059 Oct 10 12:19:13.360286 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 514/1076] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:19:13 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1558 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:19:13.384467 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:13.384976 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:13.392045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:13.392523 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:13.392977 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:13.393661 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:13.394107 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:13.394531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:13.478447 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a890ad2a-df5f-4606-8e27-c49cf1faeee8 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097881 Oct 10 12:19:13.479315 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 563/1077] 10.222.0.46 () {58 vars in 1275 bytes} [Mon Oct 10 12:19:13 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:14.344850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:14.356846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:14.360757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:14.361516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:14.361952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:14.362873 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:14.364598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:14.365221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:14.764523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:14.779376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:14.781588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:14.783571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-80b71bde-22df-4a54-badc-478ed1341744 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.443292 Oct 10 12:19:14.784374 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 515/1078] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:14 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:14.983335 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-ee0d617a-3c9f-4897-b5af-29e5626f2555 req-7fc0ecc5-f57f-4229-8821-3b4d0e4cb828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca601f1-e5dc-43b0-91ee-16f03eefb50a", "tag": "f452dd9a-f82f-4a66-84ef-1b78de8cce04"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:14.993712 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-ee0d617a-3c9f-4897-b5af-29e5626f2555 req-7fc0ecc5-f57f-4229-8821-3b4d0e4cb828 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:14.994224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-ee0d617a-3c9f-4897-b5af-29e5626f2555 req-7fc0ecc5-f57f-4229-8821-3b4d0e4cb828 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:14.994649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-ee0d617a-3c9f-4897-b5af-29e5626f2555 req-7fc0ecc5-f57f-4229-8821-3b4d0e4cb828 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:15.007201 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-ee0d617a-3c9f-4897-b5af-29e5626f2555 req-7fc0ecc5-f57f-4229-8821-3b4d0e4cb828 service nova] Creating event network-changed:f452dd9a-f82f-4a66-84ef-1b78de8cce04 for instance eca601f1-e5dc-43b0-91ee-16f03eefb50a on hv-cinder-86020 Oct 10 12:19:15.012860 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-ee0d617a-3c9f-4897-b5af-29e5626f2555 req-7fc0ecc5-f57f-4229-8821-3b4d0e4cb828 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033852 Oct 10 12:19:15.013990 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 564/1079] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:15.809583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:15.810798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:15.817471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:15.818273 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:15.818733 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:15.819455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:15.819969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:15.820323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:15.963490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:15.973075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:15.974495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:15.975763 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b551bb16-b631-475e-9a18-025bdaf6ad25 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1740 microversion: 2.20 time: 0.170146 Oct 10 12:19:15.976329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 516/1080] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:15 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:17.002450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:17.003346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:17.009649 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:17.010124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:17.014360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:17.014360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:17.014360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:17.014360 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:17.148088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:17.157136 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:17.158579 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:17.159808 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2d7f6c5d-bde6-4d58-acee-92f5646c2f5e tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1722 microversion: 2.20 time: 0.162126 Oct 10 12:19:17.160575 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 565/1081] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:16 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:18.188144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:18.188768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:18.196037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:18.196525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:18.196965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:18.197712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:18.198142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:18.198571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:18.339627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:18.348549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:18.349970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:18.351207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-195e3648-ab37-4eeb-b0b6-d80c6c8732f8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1722 microversion: 2.20 time: 0.167576 Oct 10 12:19:18.351778 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 517/1082] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:18 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:19.391894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:19.392578 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:19.399561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:19.400103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:19.400549 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:19.401251 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:19.408313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:19.408313 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:19.561354 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:19.569769 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:19.571270 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:19.572441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-cab60284-e882-48f9-958e-d49a50defcff tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1725 microversion: 2.20 time: 0.185205 Oct 10 12:19:19.574743 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 566/1083] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:19 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:19.599173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afda4a2d-dba9-4d49-9e0d-429df7be6e60"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:19.602140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:19.604726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=60 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:19.610254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:19.620511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:19.620511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:19.620511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:19.620511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:19.620919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:20.027124 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:20.030778 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:20.036738 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:20.037378 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:20.037918 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:20.038941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:20.039515 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:20.040197 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:20.066863 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d7bbd3c3-faf8-4bd2-9a36-fa9cc0555dc0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/ips" status: 200 len: 144 microversion: 2.1 time: 0.270767 Oct 10 12:19:20.067431 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 567/1084] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:19:19 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/ips => generated 144 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:19:20.072112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-9dd59c3c-eb37-4d2f-880e-0876ce61fe03 req-ab2250ac-1d7a-4718-ae3b-7555c9e21a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b", "name": "network-vif-unplugged", "status": "completed", "tag": "d904bf77-5a1e-4848-a3d8-d43e634f0c09"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:20.082226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9dd59c3c-eb37-4d2f-880e-0876ce61fe03 req-ab2250ac-1d7a-4718-ae3b-7555c9e21a0a service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:20.082757 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9dd59c3c-eb37-4d2f-880e-0876ce61fe03 req-ab2250ac-1d7a-4718-ae3b-7555c9e21a0a service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:20.083261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-9dd59c3c-eb37-4d2f-880e-0876ce61fe03 req-ab2250ac-1d7a-4718-ae3b-7555c9e21a0a service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:20.095734 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.compute.server_external_events [req-9dd59c3c-eb37-4d2f-880e-0876ce61fe03 req-ab2250ac-1d7a-4718-ae3b-7555c9e21a0a service nova] Unable to find a host for instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b. Dropping event network-vif-unplugged {{(pid=121298) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 12:19:20.096625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-9dd59c3c-eb37-4d2f-880e-0876ce61fe03 req-ab2250ac-1d7a-4718-ae3b-7555c9e21a0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028274 Oct 10 12:19:20.097437 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 568/1085] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 12:19:20.831795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cc8eb71f-f3e1-4b5c-8643-90853dfc6bec tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.236547 Oct 10 12:19:20.839771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 518/1086] 10.222.0.46 () {62 vars in 1364 bytes} [Mon Oct 10 12:19:19 2022] POST /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-volume_attachments => generated 188 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 12:19:21.018715 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:21.019904 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:21.027305 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:21.028044 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:21.029210 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:21.029958 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:21.030625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:21.031083 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:21.842454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d598f5b7-a673-43ca-88bf-56dfd89b2289 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-volume_attachments/afda4a2d-dba9-4d49-9e0d-429df7be6e60" status: 202 len: 0 microversion: 2.20 time: 0.821718 Oct 10 12:19:21.842454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 569/1087] 10.222.0.46 () {60 vars in 1457 bytes} [Mon Oct 10 12:19:21 2022] DELETE /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-volume_attachments/afda4a2d-dba9-4d49-9e0d-429df7be6e60 => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:19:21.904276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:21.904881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:21.912405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:21.916895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:21.916895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:21.916895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:21.916895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:21.917274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:21.946401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121297) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 12:19:22.230479 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [2f21d853-8569-4bc8-b620-4b41fbc362b0] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 12:19:22.826426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed71b4bf-3f87-4b8d-a6cf-5b514c7cc619"}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:22.829527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:22.836665 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:22.837393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:22.838004 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:22.838741 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:22.839500 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:22.839887 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:23.241746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [2f21d853-8569-4bc8-b620-4b41fbc362b0] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 60080. Oct 10 12:19:23.246973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9d8dc4bf-66df-4087-8feb-c69be5e9e5d7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "POST /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/action" status: 202 len: 0 microversion: 2.20 time: 1.346883 Oct 10 12:19:23.248227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 519/1088] 10.222.0.46 () {62 vars in 1319 bytes} [Mon Oct 10 12:19:21 2022] POST /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/action => generated 0 bytes in 1349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:19:23.257626 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:23.259072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:23.268478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:23.269233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:23.269922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:23.270892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:23.271604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:23.272334 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:23.439163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:23.449835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:23.451567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:23.452882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-942a6f08-c1f8-4ae1-b02d-23e0ebbaaa68 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1673 microversion: 2.20 time: 0.200315 Oct 10 12:19:23.454767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 520/1089] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:23 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:23.851314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a539bb1b-b4ca-4b69-8830-a6a539175267 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024216 Oct 10 12:19:23.851314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 570/1090] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:19:22 2022] POST /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments => generated 194 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:19:24.482283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:24.485468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:24.492342 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:24.492831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:24.493297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:24.494002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:24.494458 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:24.494950 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:24.686107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:24.694906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:24.696389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:24.697558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-86b216e8-5a23-4727-971e-ee7391b6362a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1673 microversion: 2.20 time: 0.219793 Oct 10 12:19:24.698128 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 521/1091] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:24 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:25.725269 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:25.726183 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:25.728398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:25.734258 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:25.734871 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:25.735454 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:25.736361 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:25.737047 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:25.737550 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:25.883451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:25.891728 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:25.893196 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:25.894349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f8042076-c834-4523-ad0a-b1c539abbfe2 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1673 microversion: 2.20 time: 0.174691 Oct 10 12:19:25.894944 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 571/1092] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:25 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:26.919868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:26.920579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:26.927846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:26.929663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:26.929663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:26.929663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:26.929947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:26.930320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:26.935144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:27.103905 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:27.116405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:27.119011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:27.119282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c0a0d8b4-5c28-427c-bb2e-40d0db29301a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1673 microversion: 2.20 time: 0.203561 Oct 10 12:19:27.119850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 522/1093] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:26 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:28.147682 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:28.151996 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:28.159865 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:28.160628 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:28.161220 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:28.162618 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:28.163730 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:28.166318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:28.366350 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:28.377567 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:28.379184 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:28.380678 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-abf753ef-a074-42a3-a7fb-7daf84b76340 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1673 microversion: 2.20 time: 0.238400 Oct 10 12:19:28.381942 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 572/1094] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:28 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:29.407366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:29.408162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:29.416144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:29.416989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:29.417642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:29.418652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:29.419888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:29.420564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:29.571222 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:29.579340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:29.581021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:29.584152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6b686f0a-6e6c-4a34-b059-c1103fa820a3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1675 microversion: 2.20 time: 0.180753 Oct 10 12:19:29.586723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 523/1095] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:29 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:30.616708 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:30.617355 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:30.624338 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:30.624822 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:30.625264 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:30.625964 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:30.626418 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:30.626882 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:30.798445 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:30.808981 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:30.810589 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:30.818349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-73818200-a842-4b84-b9f5-79fb983bb4a7 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.199147 Oct 10 12:19:30.818349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 573/1096] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:30 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:31.837758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:31.839337 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:31.848530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:31.849034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:31.849480 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:31.850200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:31.850659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:31.856181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:32.060821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:32.070176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:32.071703 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:32.073430 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-edec5a55-7ef2-4067-926c-5627b8bd9880 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.239841 Oct 10 12:19:32.083914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 524/1097] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:31 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:32.626588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:32.629466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:32.636410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:32.637199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:32.637885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:32.639318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:32.640287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:32.640919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:32.675017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6ad94d78-ca04-4255-b73e-8c75cb7ec1f8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052979 Oct 10 12:19:32.676098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 525/1098] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:19:32 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:19:32.687853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:32.688253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:32.695279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:32.696509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:32.697291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:32.698167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:32.698992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:32.699569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:32.705508 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-290d5d3d-92e5-494f-9973-025872cbf04e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Action: 'create', calling method: .version_select at 0x7f6d12b3dee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1906261316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLHkgKpCXl4ShtUb7lagcJuoDAjdz0dQ1e5Mq1q9PFXvBqRrwQWU/bizbgLCU3DnmtkM+aW6tQI2GvF6FjEeoSXGjg4x7DEJJ7lWzyIBBf1DSB5hq0zv2M3rTkikcfDOQ=="}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:32.725746 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-290d5d3d-92e5-494f-9973-025872cbf04e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Getting quotas for project c6ab1776de294ca1a23fc110b2f9af1d. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:19:32.730647 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.quota [None req-290d5d3d-92e5-494f-9973-025872cbf04e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Getting quotas for user 8c796e1544354dbe9d1139c77b05f477 and project c6ab1776de294ca1a23fc110b2f9af1d. Resources: {'key_pairs'} {{(pid=121298) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:19:32.736615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-723373e0-b78f-4331-841a-1466f7f95753 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/ed71b4bf-3f87-4b8d-a6cf-5b514c7cc619" status: 200 len: 194 microversion: 2.1 time: 0.053630 Oct 10 12:19:32.737274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 526/1099] 10.222.0.46 () {58 vars in 1413 bytes} [Mon Oct 10 12:19:32 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/ed71b4bf-3f87-4b8d-a6cf-5b514c7cc619 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:19:32.846345 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-290d5d3d-92e5-494f-9973-025872cbf04e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.371113 Oct 10 12:19:32.847260 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 574/1100] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:19:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:33.102239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:33.103069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:33.111336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:33.112894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:33.120303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:33.121195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:33.121724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:33.122963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:33.393024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:33.403038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:33.404919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:33.406343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2a87dc81-064e-4153-bb53-e1b159c55f76 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.309510 Oct 10 12:19:33.410963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 527/1101] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:33 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:34.433189 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:34.435040 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:34.455986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:34.456758 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:34.457515 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:34.458410 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:34.459052 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:34.459641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:34.713130 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:34.726367 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:34.727894 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:34.733569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-fa7bb361-8fbb-40de-b141-df603c11e4ee tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.304289 Oct 10 12:19:34.734561 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 575/1102] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:34 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:35.715997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6931134d-298f-49b0-a19d-c501d3327a52"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:35.719345 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:35.727860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:35.728737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:35.729724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:35.730580 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:35.731447 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:35.732355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:35.780217 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:35.780892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:35.809991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:35.810527 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:35.811580 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:35.812492 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:35.814582 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:35.815503 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:36.046242 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:36.048945 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:36.061117 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:36.064072 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:36.065584 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a14d1b04-2358-4f68-ae23-7cddcaa480d1 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.301635 Oct 10 12:19:36.066660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 576/1103] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:35 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:37.094339 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:37.097670 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:37.107462 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:37.109478 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:37.109986 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:37.110709 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:37.111166 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:37.111590 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:37.336262 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:37.346380 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:37.348289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:37.354700 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-b0d4d648-40ec-4424-948e-e5baa1ef04e3 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.261386 Oct 10 12:19:37.356145 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 577/1104] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:37 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:38.383898 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:38.385301 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:38.393520 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:38.394359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:38.394834 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:38.395554 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:38.396029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:38.397116 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:38.565016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:38.579182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:38.580886 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:38.582385 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-2acc06c1-799e-411e-bd9f-aaeb5855c3b9 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.202353 Oct 10 12:19:38.583020 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 578/1105] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:38 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:39.610767 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:39.611502 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:39.620794 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:39.621289 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:39.621736 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:39.622443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:39.622924 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:39.623357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:39.770825 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:39.780318 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:39.781823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:39.783048 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-03c3dd87-818e-45ac-acab-ba428a62a615 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.177115 Oct 10 12:19:39.783816 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 579/1106] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:39 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:40.811553 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:40.812428 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:40.819830 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:40.820843 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:40.821306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:40.822045 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:40.822510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:40.822992 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:41.002116 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:41.010791 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:41.012326 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:41.013528 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-897e8b09-1f20-4360-8026-5d23df294fea tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.207147 Oct 10 12:19:41.014101 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 580/1107] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:40 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:42.040212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:42.041582 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:42.049191 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:42.049674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:42.050153 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:42.051065 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:42.051515 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:42.051974 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:42.196188 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:42.204641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:42.206322 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:42.207546 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-8d6bad64-e4d0-4fb0-8d74-f05e17ba0de5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.171754 Oct 10 12:19:42.208119 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 581/1108] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:42 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:43.233583 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:43.234255 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:43.236147 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=4 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:43.241760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:43.248002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:43.248002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:43.248002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:43.248002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:43.248406 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:43.383679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:43.392465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:43.393880 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:43.395053 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-955f79a6-6b85-4477-8d5a-8c8f3d1a0fc8 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.165474 Oct 10 12:19:43.395617 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 582/1109] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:43 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:44.420888 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:44.421650 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:44.428739 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:44.429213 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:44.429646 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:44.430346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:44.430846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:44.431248 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:44.565619 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:44.574033 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:44.576113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:44.577283 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-478aa5dd-941f-44a2-a472-b2b0b430aa65 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.160765 Oct 10 12:19:44.577857 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 583/1110] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:44 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:45.604683 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:45.605464 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:45.613025 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:45.613510 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:45.613941 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:45.614656 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:45.615123 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:45.615543 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:45.727879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:45.761569 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:45.769985 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:45.771466 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:45.772651 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-71e3c82f-e004-4adf-8f2b-e4329c37197b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.172838 Oct 10 12:19:45.773218 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 584/1111] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:45 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:45.937360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=40 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:46.801296 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:46.802788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:46.808224 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:46.808747 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:46.809190 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:46.810587 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:46.811078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:46.811508 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:46.948133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:46.956590 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:46.958182 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:46.959404 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-141e40fc-e162-4097-9036-c751fb67e0b5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.162650 Oct 10 12:19:46.959952 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 585/1112] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:46 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:47.985276 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:47.985951 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:47.992465 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:47.992949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:47.993389 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:47.994167 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:47.994625 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:47.995078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:48.127679 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:48.136240 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:48.137693 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:48.138996 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f91d51e5-699e-4c0c-b559-57af1edb8691 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.157547 Oct 10 12:19:48.139558 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 586/1113] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:47 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:49.164441 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:49.165186 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:49.171749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:49.172164 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:49.172708 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:49.173411 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:49.173864 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:49.174290 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:49.311451 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:49.319754 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:49.321187 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:49.322391 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3835ff5f-921e-42a9-b2bc-35163bf8f9c0 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.161896 Oct 10 12:19:49.323001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 587/1114] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:49 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:19:49.484495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f15bfda6-e180-47b7-8030-9d10f353e2e0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "POST /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.773818 Oct 10 12:19:49.485117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 528/1115] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:19:35 2022] POST /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments => generated 194 bytes in 13775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:50.350346 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:50.350984 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:50.359458 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:50.359943 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:50.360379 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:50.361099 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:50.361548 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:50.361971 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:50.495064 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:50.503611 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:50.505113 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:50.506424 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-f188458e-0b39-45d9-94b1-d21af6a0818a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.159980 Oct 10 12:19:50.507015 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 588/1116] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:50 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:51.534706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:51.535434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:51.541932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:51.542555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:51.543028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:51.543726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:51.544185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:51.544615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:51.681187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:51.690540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:51.691993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:51.693142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f7623d16-556d-4820-b2d3-94e87c84492a tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.164060 Oct 10 12:19:51.693698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 529/1117] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:51 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:52.271750 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [req-43177f0c-5173-4752-ba3c-cef44edff053 req-72707c18-224a-4d9e-b35e-9ee4937d353d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b", "name": "network-vif-plugged", "status": "completed", "tag": "d904bf77-5a1e-4848-a3d8-d43e634f0c09"}]} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:19:52.282641 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-43177f0c-5173-4752-ba3c-cef44edff053 req-72707c18-224a-4d9e-b35e-9ee4937d353d service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:52.283245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-43177f0c-5173-4752-ba3c-cef44edff053 req-72707c18-224a-4d9e-b35e-9ee4937d353d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:52.283637 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [req-43177f0c-5173-4752-ba3c-cef44edff053 req-72707c18-224a-4d9e-b35e-9ee4937d353d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:52.295513 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.compute.server_external_events [req-43177f0c-5173-4752-ba3c-cef44edff053 req-72707c18-224a-4d9e-b35e-9ee4937d353d service nova] Creating event network-vif-plugged:d904bf77-5a1e-4848-a3d8-d43e634f0c09 for instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b on hv-cinder-86020 Oct 10 12:19:52.300699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [req-43177f0c-5173-4752-ba3c-cef44edff053 req-72707c18-224a-4d9e-b35e-9ee4937d353d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032618 Oct 10 12:19:52.301472 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 589/1118] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:19:52.719945 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:52.720558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:52.727057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:52.727565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:52.728000 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:52.728687 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:52.729144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:52.729567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:52.859830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:52.868943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:52.870397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:52.871648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4e5528e9-c1b3-4f62-bc58-ef1df73b4274 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.156204 Oct 10 12:19:52.872230 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 530/1119] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:52 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:53.898605 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:53.899366 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:53.906143 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:53.906624 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:53.907088 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:53.908265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:53.908265 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:53.908689 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:54.045616 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:54.053927 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:54.055447 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:54.056608 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a5471343-986b-4e29-b285-762415a60bc4 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.162923 Oct 10 12:19:54.057174 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 590/1120] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:53 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:55.081688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:55.082386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:55.089303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:55.089820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:55.090659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:55.091400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:55.091863 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:55.092791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:55.237663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:55.246313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:55.248401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:55.249570 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-63fcb263-81d3-413f-b048-e14478d58942 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.171860 Oct 10 12:19:55.250159 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 531/1121] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:55 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:56.275849 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:56.276479 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:56.280219 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:56.283657 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:56.287291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:56.287291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:56.287291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:56.287291 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:56.287807 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:56.416019 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:56.425075 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:56.426683 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:56.430804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-a18abf10-8b3c-4905-81ff-9518bd87b89f tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1731 microversion: 2.20 time: 0.156194 Oct 10 12:19:56.430804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 591/1122] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:56 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:57.454098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:57.454856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:57.461462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:57.461961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:57.462404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:57.463142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:57.463858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:57.464288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:57.601182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:57.609714 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:57.611191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:19:57.612360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fa8e970d-b721-474e-8116-e19b0faf2a14 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1718 microversion: 2.20 time: 0.162815 Oct 10 12:19:57.612938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 532/1123] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:19:57 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 12:19:59.158773 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:59.160112 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:59.167357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:59.167844 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:59.168287 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:59.169002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:59.170111 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:59.170543 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:59.203055 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-081cb82b-2ddd-4ed6-8888-9498d32910e2 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049770 Oct 10 12:19:59.203660 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 592/1124] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:19:59 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:59.344209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:59.344753 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:59.351578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:59.352066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:59.352503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:59.353198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:59.353649 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:59.354078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:59.384600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-18747b61-fba1-48a1-b66b-e0ecd686347b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/ed71b4bf-3f87-4b8d-a6cf-5b514c7cc619" status: 200 len: 194 microversion: 2.1 time: 0.045128 Oct 10 12:19:59.385298 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 533/1125] 10.222.0.46 () {58 vars in 1413 bytes} [Mon Oct 10 12:19:59 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/ed71b4bf-3f87-4b8d-a6cf-5b514c7cc619 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:19:59.396393 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:19:59.396900 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:19:59.403031 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:59.403522 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:59.404620 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:59.405330 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:19:59.405790 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:19:59.406222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:19:59.492760 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lazy-loading 'services' on Instance uuid b5e7774e-b8b3-4e69-967d-c19741018ddf {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:19:59.495198 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=100 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:59.756245 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c840c352-a271-4c79-bb1b-bf66c34eb711 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/ed71b4bf-3f87-4b8d-a6cf-5b514c7cc619" status: 202 len: 0 microversion: 2.1 time: 0.363343 Oct 10 12:19:59.756854 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 593/1126] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:19:59 2022] DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/ed71b4bf-3f87-4b8d-a6cf-5b514c7cc619 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:20:01.942978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:01.943471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:01.949833 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:01.950325 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:01.950908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:01.951612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:01.952075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:01.953153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:01.982836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a786609d-20d0-4d50-b5e0-ff550ae402b8 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/6931134d-298f-49b0-a19d-c501d3327a52" status: 200 len: 194 microversion: 2.1 time: 0.044232 Oct 10 12:20:01.983540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 534/1127] 10.222.0.46 () {58 vars in 1413 bytes} [Mon Oct 10 12:20:01 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/6931134d-298f-49b0-a19d-c501d3327a52 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:20:01.995353 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:01.996536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:02.002536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:02.003041 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:02.003480 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:02.004173 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:02.004622 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:02.005051 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:02.093306 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.objects.instance [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lazy-loading 'services' on Instance uuid b5e7774e-b8b3-4e69-967d-c19741018ddf {{(pid=121298) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:20:02.350353 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d500845e-cb09-4fbd-bcff-f7a4e27985be tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/6931134d-298f-49b0-a19d-c501d3327a52" status: 202 len: 0 microversion: 2.1 time: 0.359724 Oct 10 12:20:02.351344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 594/1128] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:20:01 2022] DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments/6931134d-298f-49b0-a19d-c501d3327a52 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:20:02.618514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-265537498", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1906261316", "security_groups": [{"name": "tempest-secgroup-smoke-1198480557"}], "networks": [{"uuid": "9f8f922a-ec8b-42d4-a75e-2afb2158a141"}], "block_device_mapping_v2": [{"uuid": "8b38131b-6c74-4540-9b03-92f972778d9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:20:02.738118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] validate_networks() for [('9f8f922a-ec8b-42d4-a75e-2afb2158a141', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:20:03.112773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:20:03.113346 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:20:03.113691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:20:03.114101 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:20:03.114517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:20:03.123348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:03.123836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:03.124277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:03.125556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:03.126015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:03.126445 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:03.143023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Getting quotas for project c6ab1776de294ca1a23fc110b2f9af1d. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:20:03.146960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Getting quotas for user 8c796e1544354dbe9d1139c77b05f477 and project c6ab1776de294ca1a23fc110b2f9af1d. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:20:03.203514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:20:03.205669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b38131b-6c74-4540-9b03-92f972778d9e',volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:20:03.676435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-caa0bd71-be77-4495-852c-35c7389e0bc6 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.061896 Oct 10 12:20:03.677202 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 535/1129] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:20:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 12:20:03.689222 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-c161f830-7481-4134-854f-d8750cb7777b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:03.689916 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-c161f830-7481-4134-854f-d8750cb7777b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:03.746932 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-c161f830-7481-4134-854f-d8750cb7777b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:03.754236 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-c161f830-7481-4134-854f-d8750cb7777b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1088 microversion: 2.1 time: 0.069196 Oct 10 12:20:03.755132 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 595/1130] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:03 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:04.778255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:04.778921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:04.786310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:04.786819 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:04.787258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:04.787955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:04.788410 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:04.788836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:04.860297 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:04.863392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b524ee39-714c-4e31-92e4-67c91747217b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1138 microversion: 2.1 time: 0.089597 Oct 10 12:20:04.863978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 536/1131] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:04 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:05.886100 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:05.886749 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:05.894917 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:05.895405 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:05.895847 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:05.896544 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:05.897001 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:05.897429 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:05.958102 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:05.967357 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-e86d5de9-660a-42f5-bc88-a7419d983656 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1138 microversion: 2.1 time: 0.085085 Oct 10 12:20:05.967987 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 596/1132] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:05 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:06.989881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:06.990608 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:06.997696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:06.998176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:06.998613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:06.999333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:07.006564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:07.006564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:07.064486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:07.072454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e7eda985-84b1-471d-84a5-45ca50231f69 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1186 microversion: 2.1 time: 0.086438 Oct 10 12:20:07.073393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 537/1133] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:06 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:07.770536 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:07.773084 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:07.779904 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:07.780450 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:07.780892 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:07.781600 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:07.782239 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:07.782698 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:07.814057 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-41fd4740-fd9b-417a-9d9d-17f886f9d2d0 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046870 Oct 10 12:20:07.814748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 597/1134] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:20:07 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:20:07.946061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:07.948397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:07.954451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:07.954971 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:07.955558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:07.956283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:07.956759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:07.957228 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:08.001028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-10081044-8530-4f4d-81a5-ccf3214d0e4a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058999 Oct 10 12:20:08.002034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 538/1135] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:20:07 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:20:08.098147 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:08.098931 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:08.103423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:08.104635 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:08.108390 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:08.109234 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:08.111268 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:08.112193 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:08.112446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:08.112856 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:08.113234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:08.120469 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:08.120793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:08.120793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:08.120793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:08.120793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:08.146216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:20:08.189338 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:08.197244 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-0824ca4d-ef15-419b-8a1a-f548dd295d2a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1204 microversion: 2.1 time: 0.104130 Oct 10 12:20:08.197818 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 598/1136] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:08 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:08.549620 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b0bc9f90-15a6-4d18-94e8-196cdac1bc03 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 204 len: 0 microversion: 2.1 time: 0.450235 Oct 10 12:20:08.550371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 539/1137] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:20:08 2022] DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:20:08.558705 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:08.559426 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:08.566507 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:08.567026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:08.567537 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:08.568674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:08.569133 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:08.569564 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:08.744490 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:08.751901 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-77c4c165-ea12-4112-b596-adf41e92015c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1672 microversion: 2.1 time: 0.197011 Oct 10 12:20:08.767104 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 599/1138] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:08 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1672 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:09.221288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:09.222007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:09.228347 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:09.228826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:09.229258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:09.229941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:09.230391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:09.230836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:09.361559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:09.369196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ffc47942-89ea-4875-b09d-622e43d8cfc1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1272 microversion: 2.1 time: 0.152818 Oct 10 12:20:09.369765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 540/1139] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:09 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:09.776477 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:09.777109 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:09.784314 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:09.784807 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:09.785370 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:09.786084 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:09.786539 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:09.787002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:09.924220 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:09.932214 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-09a1f1aa-aeef-424c-ab23-f3907ce6d1f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1672 microversion: 2.1 time: 0.160208 Oct 10 12:20:09.932788 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 600/1140] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:09 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:10.392373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:10.393013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:10.400591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:10.401083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:10.401522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:10.402305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:10.402807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:10.403239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:10.543708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:10.551494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a4065039-96c3-4f7d-a5db-5423f9da387d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1272 microversion: 2.1 time: 0.163072 Oct 10 12:20:10.552071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 541/1141] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:10 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:10.963804 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:10.965259 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:10.972284 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:10.972771 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:10.973212 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:10.973925 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:10.974547 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:10.976755 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:11.114140 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:11.122078 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3f35926a-f913-4267-90c0-88b975ba8e8c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1672 microversion: 2.1 time: 0.168719 Oct 10 12:20:11.122748 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 601/1142] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:10 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:11.238993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-a34a0c2b-c401-4eae-9fb5-1eba32ec644a req-09e402ac-55c7-40a8-9e47-ad0e8d9ac21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8283f5-756d-4f3b-b196-70911e57a279", "tag": "1ab60eb3-8fcd-4845-885c-e9230a320fe7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:20:11.248578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a34a0c2b-c401-4eae-9fb5-1eba32ec644a req-09e402ac-55c7-40a8-9e47-ad0e8d9ac21d service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:11.249109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a34a0c2b-c401-4eae-9fb5-1eba32ec644a req-09e402ac-55c7-40a8-9e47-ad0e8d9ac21d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:11.249495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-a34a0c2b-c401-4eae-9fb5-1eba32ec644a req-09e402ac-55c7-40a8-9e47-ad0e8d9ac21d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:11.260740 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-a34a0c2b-c401-4eae-9fb5-1eba32ec644a req-09e402ac-55c7-40a8-9e47-ad0e8d9ac21d service nova] Creating event network-changed:1ab60eb3-8fcd-4845-885c-e9230a320fe7 for instance 7b8283f5-756d-4f3b-b196-70911e57a279 on hv-cinder-86020 Oct 10 12:20:11.265571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-a34a0c2b-c401-4eae-9fb5-1eba32ec644a req-09e402ac-55c7-40a8-9e47-ad0e8d9ac21d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091437 Oct 10 12:20:11.266148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 542/1143] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:20:11.576674 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:11.577531 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:11.585268 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:11.585846 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:11.586282 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:11.587103 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:11.587557 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:11.588039 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:11.727254 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:11.739225 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-dc5537c6-fb4d-4087-8a83-3d088fdd0e92 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.163816 Oct 10 12:20:11.739225 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 602/1144] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:11 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:12.148299 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:12.150330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:12.156592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:12.157167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:12.158427 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:12.158427 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:12.159488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:12.159488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:12.307283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:12.310921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:12.315512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-660d24cc-123f-45b6-a291-e8e7c0b2f595 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1672 microversion: 2.1 time: 0.172744 Oct 10 12:20:12.316252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 543/1145] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:12 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:12.759056 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:12.759842 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:12.766275 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:12.766808 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:12.767252 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:12.767949 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:12.768455 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:12.768878 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:12.911261 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:12.919239 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-bd48511b-c889-4f20-a2f6-9bdee1556bcd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.164196 Oct 10 12:20:12.921789 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 603/1146] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:12 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:13.280032 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-99f0abc2-a151-49e5-a012-e0cafc6e1bf4 req-88d1e3c2-7190-4f09-bdeb-5099a4c35805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e7774e-b8b3-4e69-967d-c19741018ddf", "name": "network-vif-deleted", "tag": "1837ddef-a7eb-4bd3-b4f5-a127aa82e594"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:20:13.285442 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:13.286692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=6 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:13.297685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-99f0abc2-a151-49e5-a012-e0cafc6e1bf4 req-88d1e3c2-7190-4f09-bdeb-5099a4c35805 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:13.297685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-99f0abc2-a151-49e5-a012-e0cafc6e1bf4 req-88d1e3c2-7190-4f09-bdeb-5099a4c35805 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:13.297685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-99f0abc2-a151-49e5-a012-e0cafc6e1bf4 req-88d1e3c2-7190-4f09-bdeb-5099a4c35805 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:13.307692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-99f0abc2-a151-49e5-a012-e0cafc6e1bf4 req-88d1e3c2-7190-4f09-bdeb-5099a4c35805 service nova] Creating event network-vif-deleted:1837ddef-a7eb-4bd3-b4f5-a127aa82e594 for instance b5e7774e-b8b3-4e69-967d-c19741018ddf on hv-cinder-86020 Oct 10 12:20:13.312736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-99f0abc2-a151-49e5-a012-e0cafc6e1bf4 req-88d1e3c2-7190-4f09-bdeb-5099a4c35805 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036676 Oct 10 12:20:13.313333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 544/1147] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:20:13.340180 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:13.340876 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:13.347076 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:13.348121 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:13.349398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:13.349398 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:13.349762 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:13.350287 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:13.413002 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:13.420896 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-d8a52b4a-86b4-4540-add4-fc65018f499b tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1604 microversion: 2.1 time: 0.084801 Oct 10 12:20:13.428007 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 604/1148] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:13 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1604 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:13.946591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:13.947379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:13.955038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:13.955524 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:13.955955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:13.957200 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:13.957648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:13.958072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:14.100074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:14.107982 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bf144d20-9e55-435d-8efa-03e8656293d7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.166603 Oct 10 12:20:14.108641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 545/1149] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:13 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:14.445741 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:14.446349 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:14.448295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell0:SELECT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:14.456699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:14.456699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:14.456699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:14.456699 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:14.458009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:14.458009 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:14.524938 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:14.533036 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-3628ac21-920a-4767-aafa-a257eea695bf tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1604 microversion: 2.1 time: 0.091681 Oct 10 12:20:14.533619 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 605/1150] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:14 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:15.130639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:15.131277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:15.138063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:15.138550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:15.139019 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:15.139723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:15.140180 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:15.140611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:15.280957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:15.289610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3324a555-0c9a-4b3f-9934-0bc9505fc9f0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.162999 Oct 10 12:20:15.290186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 546/1151] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:15 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:15.556707 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:15.557249 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.compute.api [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121298) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:15.563902 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:15.564383 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:15.564823 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:15.565511 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:15.566016 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:15.566443 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG oslo_concurrency.lockutils [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:15.632972 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.policy [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b334b2401e14419284cce2ad61442d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98437356d32f4230bce856ce6ddae66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121298) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:15.641438 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO nova.api.openstack.requestlog [None req-7741bb4f-1733-469a-b17b-cd637435f58a tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 200 len: 1322 microversion: 2.1 time: 0.088821 Oct 10 12:20:15.642026 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: [pid: 121298|app: 0|req: 606/1152] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:15 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 1322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:16.313947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:16.317189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:16.321295 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.api.openstack.wsgi [None req-1cb60ccc-ed7e-49b9-9b8f-ef1532f97494 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1360780277", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1382985420", "security_groups": [{"name": "tempest-secgroup-smoke-390021896"}], "block_device_mapping_v2": [{"uuid": "9a26e015-0aa6-44e6-bb91-80f7aba1ee8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "467adefb-be40-4a7b-be51-41e12ba7cbdd"}]}} {{(pid=121298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:20:16.321444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:16.326467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:16.326913 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:16.327349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:16.328047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:16.328543 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:16.329144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:16.481874 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG nova.network.neutron [None req-1cb60ccc-ed7e-49b9-9b8f-ef1532f97494 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] validate_networks() for [('467adefb-be40-4a7b-be51-41e12ba7cbdd', None, None, None, None, None)] {{(pid=121298) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:20:16.507898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:16.515961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-976d3124-0a78-4dd5-8817-8dba9f06cb41 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.206183 Oct 10 12:20:16.516630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 547/1153] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:16 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:20:16.665859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:16.666466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:16.672992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:16.673479 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:16.673993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:16.674947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:16.675190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:16.679326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:16.690094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] HTTP exception thrown: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Request method failure captured: Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf HTTP/1.1 Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAseUfMyYWX_8Ldf20rij5EuP9PdwtW_Btam8A5P25mk6sk_IHLyQgGwF7PfRW54UtPeKNW-6TxGyy0WsGjcuCzmjlfupVrdn3KUPRJBBxrfk7cbgExDnSvECaBSPuVb14Cx7ApMyVgLzTqlmvu75UQvmmySc1hItYMEgBnkcClMtyk Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:20:16.691975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_98437356d32f4230bce856ce6ddae66a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: b334b2401e14419284cce2ad61442d4a Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:16.693575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'b5e7774e-b8b3-4e69-967d-c19741018ddf'} Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:20:16.694647 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:16.696245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:16.697696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Returning 404 to user: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:20:16.697696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9a5ec222-a90a-4741-aa9b-580254787521 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 404 len: 111 microversion: 2.1 time: 0.031400 Oct 10 12:20:16.697696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 548/1154] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:16 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:20:16.702366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-aabdc802-de87-433b-a63d-831d0cb8b4e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '.version_select at 0x7f6d12a234c0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:16.808487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-aabdc802-de87-433b-a63d-831d0cb8b4e6 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730073187" status: 202 len: 0 microversion: 2.1 time: 0.109868 Oct 10 12:20:16.809109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 549/1155] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 10 12:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730073187 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:20:17.539970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:17.540643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:17.548923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:17.549538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:17.551350 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:17.552464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:17.553026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:17.553553 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:17.697307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:17.705604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e6fe7330-ebfc-4676-b8e7-43a8963b3d7b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.170816 Oct 10 12:20:17.706249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 550/1156] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:17 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:18.729114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:18.729780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:18.736798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:18.737215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:18.738167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:18.738943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:18.739411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:18.739841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:18.879472 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:18.887595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7f7bfb04-4710-4dcb-b34d-f32931340c98 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.162581 Oct 10 12:20:18.888246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 551/1157] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:18 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:19.911241 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:19.911977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:19.918730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:19.919237 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:19.919684 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:19.920393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:19.920853 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:19.921284 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:20.064129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:20.072282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bb3ef75d-e2b8-4f6f-826b-f9cc5d1ab2dd tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.165440 Oct 10 12:20:20.072948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 552/1158] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:19 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:20.479920 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:20.480429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:20.486619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:20.487134 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:20.487575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:20.488777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:20.489232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:20.489659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:20.504271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] HTTP exception thrown: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Request method failure captured: Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf HTTP/1.1 Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAseUfMyYWX_8Ldf20rij5EuP9PdwtW_Btam8A5P25mk6sk_IHLyQgGwF7PfRW54UtPeKNW-6TxGyy0WsGjcuCzmjlfupVrdn3KUPRJBBxrfk7cbgExDnSvECaBSPuVb14Cx7ApMyVgLzTqlmvu75UQvmmySc1hItYMEgBnkcClMtyk Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:20:20.505854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_98437356d32f4230bce856ce6ddae66a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: b334b2401e14419284cce2ad61442d4a Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.507376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'b5e7774e-b8b3-4e69-967d-c19741018ddf'} Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:20:20.508097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.509424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.510921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Returning 404 to user: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:20:20.510921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eafb8543-04f8-46fb-8813-bc3e806ac8f4 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 404 len: 111 microversion: 2.1 time: 0.031320 Oct 10 12:20:20.510921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 553/1159] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:20:20 2022] DELETE /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:20:20.515869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:20.516486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: b5e7774e-b8b3-4e69-967d-c19741018ddf] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:20.522623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:20.523078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:20.523521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:20.524236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:20.524690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:20.525117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:20.540025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] HTTP exception thrown: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Request method failure captured: Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf HTTP/1.1 Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAseUfMyYWX_8Ldf20rij5EuP9PdwtW_Btam8A5P25mk6sk_IHLyQgGwF7PfRW54UtPeKNW-6TxGyy0WsGjcuCzmjlfupVrdn3KUPRJBBxrfk7cbgExDnSvECaBSPuVb14Cx7ApMyVgLzTqlmvu75UQvmmySc1hItYMEgBnkcClMtyk Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:20:20.541575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_98437356d32f4230bce856ce6ddae66a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: b334b2401e14419284cce2ad61442d4a Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.543243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'b5e7774e-b8b3-4e69-967d-c19741018ddf'} Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:20:20.544170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. Oct 10 12:20:20.545655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:20.547023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Returning 404 to user: Instance b5e7774e-b8b3-4e69-967d-c19741018ddf could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:20:20.547023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cc3a7670-1dda-4f49-968b-c9f253322944 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf" status: 404 len: 111 microversion: 2.1 time: 0.030967 Oct 10 12:20:20.547023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 554/1160] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:20 2022] GET /compute/v2.1/servers/b5e7774e-b8b3-4e69-967d-c19741018ddf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:20:21.095592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:21.096356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:21.103777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:21.104290 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:21.104716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:21.105427 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:21.105882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:21.106313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:21.242972 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:21.251880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3690e36d-4b09-40b1-a376-26b5733f03eb tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.160248 Oct 10 12:20:21.252470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 555/1161] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:21 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:21.876679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:21.878221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:21.884113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:21.884722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:21.885168 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:21.885880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:21.886341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:21.886861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:21.901094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] HTTP exception thrown: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Request method failure captured: Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e HTTP/1.1 Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAseUfMyYWX_8Ldf20rij5EuP9PdwtW_Btam8A5P25mk6sk_IHLyQgGwF7PfRW54UtPeKNW-6TxGyy0WsGjcuCzmjlfupVrdn3KUPRJBBxrfk7cbgExDnSvECaBSPuVb14Cx7ApMyVgLzTqlmvu75UQvmmySc1hItYMEgBnkcClMtyk Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:20:21.902696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_98437356d32f4230bce856ce6ddae66a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: b334b2401e14419284cce2ad61442d4a Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.904218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '13c0121a-4f1a-4265-9efd-5a969d73bb7e'} Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:20:21.905028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.906391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.907767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Returning 404 to user: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:20:21.907767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7f22531c-98de-4d97-976d-5c87f0c6048c tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 404 len: 111 microversion: 2.1 time: 0.031517 Oct 10 12:20:21.907767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 556/1162] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:20:21 2022] DELETE /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:20:21.912942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:21.915178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] [instance: 13c0121a-4f1a-4265-9efd-5a969d73bb7e] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:21.919681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:21.920170 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:21.920612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:21.921317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:21.921778 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:21.922259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:21.936594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] HTTP exception thrown: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Request method failure captured: Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e HTTP/1.1 Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAseUfMyYWX_8Ldf20rij5EuP9PdwtW_Btam8A5P25mk6sk_IHLyQgGwF7PfRW54UtPeKNW-6TxGyy0WsGjcuCzmjlfupVrdn3KUPRJBBxrfk7cbgExDnSvECaBSPuVb14Cx7ApMyVgLzTqlmvu75UQvmmySc1hItYMEgBnkcClMtyk Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:20:21.938140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_98437356d32f4230bce856ce6ddae66a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/98437356d32f4230bce856ce6ddae66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 98437356d32f4230bce856ce6ddae66a Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeTestJSON-711511588 Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: b334b2401e14419284cce2ad61442d4a Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeTestJSON-711511588-project Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.940079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '13c0121a-4f1a-4265-9efd-5a969d73bb7e'} Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:20:21.941073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. Oct 10 12:20:21.943034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:20:21.944499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] Returning 404 to user: Instance 13c0121a-4f1a-4265-9efd-5a969d73bb7e could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:20:21.944499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6372d8a2-830a-43ac-a955-319bf4770482 tempest-AttachVolumeTestJSON-711511588 tempest-AttachVolumeTestJSON-711511588-project] 10.222.0.46 "GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e" status: 404 len: 111 microversion: 2.1 time: 0.030874 Oct 10 12:20:21.945211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 557/1163] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:21 2022] GET /compute/v2.1/servers/13c0121a-4f1a-4265-9efd-5a969d73bb7e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:20:22.274412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:22.275109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:22.281754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:22.282235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:22.282692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:22.283397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:22.283847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:22.284268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:22.441603 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:22.457536 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-433957f2-d51b-499c-a7a5-d2001de687e5 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.186462 Oct 10 12:20:22.459601 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 558/1164] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:22 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:23.483463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:23.484094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:23.490392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:23.490942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:23.491392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:23.492106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:23.492559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:23.492987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:23.651772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:23.660537 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9d8ad287-7f1b-490b-a8ac-5cefa8c83c0e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.181120 Oct 10 12:20:23.661166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 559/1165] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:23 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:24.543025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-3a1a5d6c-0f16-471a-aea9-b8b67d78f600 req-5c330ec9-49f0-4c1f-858e-df562cf28b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8283f5-756d-4f3b-b196-70911e57a279", "name": "network-vif-plugged", "status": "completed", "tag": "1ab60eb3-8fcd-4845-885c-e9230a320fe7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:20:24.553868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-3a1a5d6c-0f16-471a-aea9-b8b67d78f600 req-5c330ec9-49f0-4c1f-858e-df562cf28b13 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:24.554349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-3a1a5d6c-0f16-471a-aea9-b8b67d78f600 req-5c330ec9-49f0-4c1f-858e-df562cf28b13 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:24.554803 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-3a1a5d6c-0f16-471a-aea9-b8b67d78f600 req-5c330ec9-49f0-4c1f-858e-df562cf28b13 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:24.566467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-3a1a5d6c-0f16-471a-aea9-b8b67d78f600 req-5c330ec9-49f0-4c1f-858e-df562cf28b13 service nova] Creating event network-vif-plugged:1ab60eb3-8fcd-4845-885c-e9230a320fe7 for instance 7b8283f5-756d-4f3b-b196-70911e57a279 on hv-cinder-86020 Oct 10 12:20:24.572013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-3a1a5d6c-0f16-471a-aea9-b8b67d78f600 req-5c330ec9-49f0-4c1f-858e-df562cf28b13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033259 Oct 10 12:20:24.572785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 560/1166] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:20:24.684153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:24.684882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:24.691734 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:24.692812 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:24.693257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:24.694088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:24.694550 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:24.695014 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:25.166143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:25.174860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6da80c0d-5e74-4c32-876f-f085b929ad09 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.495070 Oct 10 12:20:25.194527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 561/1167] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:24 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:25.637629 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:26.199707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:26.204844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:26.206841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:26.207332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:26.207802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:26.208505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:26.208957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:26.209381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:26.332397 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: DEBUG dbcounter [-] [121298] Writing DB stats nova_api:SELECT=35 {{(pid=121298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:26.355478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:26.362193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d8efd3e3-2eee-46ae-9ba9-2042eaefa155 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.166365 Oct 10 12:20:26.382851 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 562/1168] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:26 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:27.389390 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:27.390084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:27.397566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:27.398053 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:27.398488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:27.399213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:27.399669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:27.400097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:27.534197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:27.542558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-92eab596-92a4-46ff-9d29-b4f95a205e38 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1260 microversion: 2.1 time: 0.156994 Oct 10 12:20:27.543160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 563/1169] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:27 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:28.566006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:28.566685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:28.573883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:28.574373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:28.574842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:28.575556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:28.576308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:28.576744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:28.710820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:28.718860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ec8dadfa-8711-47df-b9df-c2bb8b573480 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1444 microversion: 2.1 time: 0.156856 Oct 10 12:20:28.719455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 564/1170] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:28 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:28.741618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:20:28.742215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:20:28.748472 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:28.748988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:28.749634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:28.750828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:28.750828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:28.751221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:28.888355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:20:28.896274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a80b4802-ca7d-42d5-a1a0-6585438db532 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1444 microversion: 2.1 time: 0.159390 Oct 10 12:20:28.896852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 565/1171] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:20:28 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:20:31.099001 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-764669ce-9441-4e4e-aa2a-fd0096e6eaae req-4a2054cc-c34f-47fe-9c9d-5e399e4a9030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8283f5-756d-4f3b-b196-70911e57a279", "tag": "1ab60eb3-8fcd-4845-885c-e9230a320fe7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:20:31.109562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-764669ce-9441-4e4e-aa2a-fd0096e6eaae req-4a2054cc-c34f-47fe-9c9d-5e399e4a9030 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:20:31.110040 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-764669ce-9441-4e4e-aa2a-fd0096e6eaae req-4a2054cc-c34f-47fe-9c9d-5e399e4a9030 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:20:31.110678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-764669ce-9441-4e4e-aa2a-fd0096e6eaae req-4a2054cc-c34f-47fe-9c9d-5e399e4a9030 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:20:31.115009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:31.123355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-764669ce-9441-4e4e-aa2a-fd0096e6eaae req-4a2054cc-c34f-47fe-9c9d-5e399e4a9030 service nova] Creating event network-changed:1ab60eb3-8fcd-4845-885c-e9230a320fe7 for instance 7b8283f5-756d-4f3b-b196-70911e57a279 on hv-cinder-86020 Oct 10 12:20:31.130017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-764669ce-9441-4e4e-aa2a-fd0096e6eaae req-4a2054cc-c34f-47fe-9c9d-5e399e4a9030 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Oct 10 12:20:31.130640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 566/1172] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:04.568280 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:04.569179 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:04.571748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:04.577566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:04.578065 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:04.578580 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:04.579372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:04.580197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:04.580368 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:04.608621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-686d8fd7-20f5-451f-a49b-77ac933816e4 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/ips" status: 200 len: 149 microversion: 2.1 time: 0.045398 Oct 10 12:21:04.609266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 567/1173] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:21:04 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:07.353006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66bc9a18-d525-49c9-8f0e-dcdb278885c3"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:21:07.355416 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:07.362609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:07.363115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:07.363553 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:07.364287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:07.365120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:07.365255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:08.260144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9d1739da-66df-4787-96f5-0426fe1f2dac tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "POST /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.910735 Oct 10 12:21:08.261264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 568/1174] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:21:07 2022] POST /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:14.715762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:14.718121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:14.724665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:14.725148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:14.725579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:14.726270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:14.726748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:14.727172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:14.757839 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-512d813c-aa0a-41d0-b25a-ac55083d9e11 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047814 Oct 10 12:21:14.758371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 569/1175] 10.222.0.46 () {60 vars in 1343 bytes} [Mon Oct 10 12:21:14 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:21:14.821692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:14.822207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:14.828695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:14.829182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:14.829622 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:14.830317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:14.830802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:14.831233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:14.856751 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:21:15.138954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f85bbd52-9b4d-4ae4-b7ca-21840b6fb119 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 204 len: 0 microversion: 2.20 time: 0.320716 Oct 10 12:21:15.139755 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 570/1176] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 10 12:21:14 2022] DELETE /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 12:21:15.149096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:15.149798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:15.155811 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:15.156332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:15.156774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:15.157470 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:15.157955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:15.158388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:15.291289 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:15.299358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:15.300785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:15.301931 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6010c75e-df0b-471c-b01f-7d736e671a77 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.157261 Oct 10 12:21:15.302482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 571/1177] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:15 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:21:16.328327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:16.328944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:16.335360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:16.335912 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:16.336355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:16.337296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:16.337747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:16.338172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:16.476591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:16.485993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:16.487474 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:16.492725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7cbd25ea-b8d9-4ef7-8637-3559d192519d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.164492 Oct 10 12:21:16.492725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 572/1178] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:16 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:21:17.515831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:17.516512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:17.523103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:17.523591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:17.524030 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:17.524804 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:17.525260 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:17.525719 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:17.655266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:17.663723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:17.665174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:17.666362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5f4677eb-27df-4cd2-b956-ef3a914acd74 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.155504 Oct 10 12:21:17.666960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 573/1179] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:17 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:21:18.693328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:18.694015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:18.700414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:18.700932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:18.701366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:18.702055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:18.702499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:18.702944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:18.840016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:18.851455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:18.852750 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:18.854513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ca492dae-fe0b-4c2e-8901-9a7c2bf55195 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1724 microversion: 2.20 time: 0.164948 Oct 10 12:21:18.871911 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 574/1180] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:18 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:21:19.151276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:19.151774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:19.157796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.158280 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.158934 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.159886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.160352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.160780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.251034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'services' on Instance uuid eca601f1-e5dc-43b0-91ee-16f03eefb50a {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:21:19.492239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e2836d97-0010-42e7-b082-5d66f5e2ed1a tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments/66bc9a18-d525-49c9-8f0e-dcdb278885c3" status: 202 len: 0 microversion: 2.1 time: 0.344752 Oct 10 12:21:19.493556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 575/1181] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:21:19 2022] DELETE /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments/66bc9a18-d525-49c9-8f0e-dcdb278885c3 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:21:19.499253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-450754f7-0f23-452c-9a35-b6bbdc07a5cf req-512f5232-e8c0-4eac-8e86-92e6dc38c6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b", "name": "network-vif-deleted", "tag": "d904bf77-5a1e-4848-a3d8-d43e634f0c09"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:21:19.519591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-450754f7-0f23-452c-9a35-b6bbdc07a5cf req-512f5232-e8c0-4eac-8e86-92e6dc38c6a4 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.520990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-450754f7-0f23-452c-9a35-b6bbdc07a5cf req-512f5232-e8c0-4eac-8e86-92e6dc38c6a4 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.521948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-450754f7-0f23-452c-9a35-b6bbdc07a5cf req-512f5232-e8c0-4eac-8e86-92e6dc38c6a4 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.540783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-450754f7-0f23-452c-9a35-b6bbdc07a5cf req-512f5232-e8c0-4eac-8e86-92e6dc38c6a4 service nova] Creating event network-vif-deleted:d904bf77-5a1e-4848-a3d8-d43e634f0c09 for instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b on hv-cinder-86020 Oct 10 12:21:19.547628 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-450754f7-0f23-452c-9a35-b6bbdc07a5cf req-512f5232-e8c0-4eac-8e86-92e6dc38c6a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052364 Oct 10 12:21:19.548401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 576/1182] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:19.557957 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:19.560248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:19.567104 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.567922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.568418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.569247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.570566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.571145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.612575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-884d4f08-601f-484a-94db-580bf70f6389 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059920 Oct 10 12:21:19.614965 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 577/1183] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:21:19 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:19.881409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:19.882768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:19.890315 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.892011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.892011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.892471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.892928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.893349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.942595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:19.944013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:19.949517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:19.949517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lazy-loading 'fault' on Instance uuid 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:21:20.003859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:20.013267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:20.015044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:20.016379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7863092e-ec13-4362-8fec-40e0b61a6871 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1372 microversion: 2.20 time: 0.139163 Oct 10 12:21:20.017271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 578/1184] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:19 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:21:20.022389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:20.022903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:20.030132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:20.030615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:20.031147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:20.031837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:20.032283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:20.032873 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:20.059981 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:21:20.092227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:20.369408 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-955438bc-4eeb-48ac-9e10-792268ba7f10 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 204 len: 0 microversion: 2.1 time: 0.350241 Oct 10 12:21:20.370018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 579/1185] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:21:20 2022] DELETE /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:21:20.390616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-68d82a6e-59d0-4a6a-a5ca-83d7c999f943 req-8ba6e2d1-db9c-4aa6-b2aa-16810d11102f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25", "tag": "7ba57a2d-ce5e-46be-bfeb-ce6690c962c7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:21:20.405271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-68d82a6e-59d0-4a6a-a5ca-83d7c999f943 req-8ba6e2d1-db9c-4aa6-b2aa-16810d11102f service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:20.405757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-68d82a6e-59d0-4a6a-a5ca-83d7c999f943 req-8ba6e2d1-db9c-4aa6-b2aa-16810d11102f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:20.406197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-68d82a6e-59d0-4a6a-a5ca-83d7c999f943 req-8ba6e2d1-db9c-4aa6-b2aa-16810d11102f service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:20.422228 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-68d82a6e-59d0-4a6a-a5ca-83d7c999f943 req-8ba6e2d1-db9c-4aa6-b2aa-16810d11102f service nova] Creating event network-changed:7ba57a2d-ce5e-46be-bfeb-ce6690c962c7 for instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 on hv-cinder-86020 Oct 10 12:21:20.427537 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-68d82a6e-59d0-4a6a-a5ca-83d7c999f943 req-8ba6e2d1-db9c-4aa6-b2aa-16810d11102f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047858 Oct 10 12:21:20.428162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 580/1186] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:20.435792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:20.436504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:20.444355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:20.445077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:20.446828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:20.446828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:20.447261 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:20.447871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:20.598538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:20.607501 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-72605b6e-b9fb-4fba-9dc1-833ed607f581 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1579 microversion: 2.1 time: 0.176539 Oct 10 12:21:20.608101 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 581/1187] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:20 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:20.625348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:20.627683 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:20.633826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:20.634313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:20.634777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:20.635474 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:20.635928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:20.636353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:20.669582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7f387d47-7424-4250-8cd9-73566bfcd0dd tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Oct 10 12:21:20.670166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 582/1188] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:21:20 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:21.043288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:21.043924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:21.050301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:21.052093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:21.052093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:21.052093 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:21.052397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:21.052816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:21.084021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:21.084491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:21.084921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:21.085356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lazy-loading 'fault' on Instance uuid 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:21:21.125783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:21.133939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:21.135421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:21.136579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e95b5918-73cf-4a18-ac51-e158702d4d4b tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1372 microversion: 2.20 time: 0.097270 Oct 10 12:21:21.137149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 583/1189] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:21 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:21:21.630598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:21.633846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:21.637244 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:21.637722 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:21.638153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:21.638876 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:21.639329 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:21.639752 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:21.780899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:21.789271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ed68ba58-fb6c-424b-a689-fdffcf17a55f tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1579 microversion: 2.1 time: 0.162426 Oct 10 12:21:21.789815 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 584/1190] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:21 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:21.811527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:21.814189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:21.820420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:21.821121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:21.821706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:21.823215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:21.823675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:21.824096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:21.855203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5b27c594-fd67-49aa-8c57-53486eafc374 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048306 Oct 10 12:21:21.855782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 585/1191] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:21:21 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:22.161482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:22.162095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:22.168461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:22.168954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:22.169929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:22.170646 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:22.171122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:22.171551 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:22.205714 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:22.206203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:22.206713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:22.207132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lazy-loading 'fault' on Instance uuid 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:21:22.264802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:22.273146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:22.274627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a87488f78444c3ad820527e5fbc099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af22e9604d79499aa9b7c2ee3cef156d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:22.275822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-81033629-e38d-4930-a027-2dace8cbdbd5 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 200 len: 1372 microversion: 2.20 time: 0.118368 Oct 10 12:21:22.276384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 586/1192] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:22 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 12:21:22.815356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:22.816276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:22.825130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:22.825875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:22.826471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:22.827110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:22.827777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:22.828383 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:22.967631 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:22.975950 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c5ca14c3-88b0-4ddd-84b1-5c8056d37322 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1579 microversion: 2.1 time: 0.166343 Oct 10 12:21:22.976540 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 587/1193] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:22 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:22.981220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:22.983405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:22.990655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:22.993976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:22.993976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:22.993976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:22.993976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:22.994302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.024117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-923c3c44-2b42-46f3-8248-0bdfe3f3e0cc tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046527 Oct 10 12:21:23.024726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 588/1194] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:21:22 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 12:21:23.096862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:23.097806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:23.104726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:23.105574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:23.106198 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.107166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:23.107793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:23.108367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.137167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:21:23.751846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-702a9609-7dc2-4003-a5d2-4583c8df7b20 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 204 len: 0 microversion: 2.1 time: 0.658682 Oct 10 12:21:23.752583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 589/1195] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:21:23 2022] DELETE /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:21:23.758037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:23.758793 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:23.764912 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:23.766505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:23.766505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.766505 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:23.767011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:23.767439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.781318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] HTTP exception thrown: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Request method failure captured: Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b HTTP/1.1 Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsfEAnwDHsAhpjCXAfeDuQhWD63I_4Er2RvSbFNdNHOCBiR21CW9DgROmj5QXEnA39MDKjJ9Z5D0GaYVvmxNL__ws5ixHkWkatmgCDTbeUpZwy4Kjj83gAmhXxQHgIbckr4I81Yz_ZyMNM9fY19nGcu3eBcyvrvpvpvJR7WqjjXMQA Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:23.783183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af22e9604d79499aa9b7c2ee3cef156d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: a7a87488f78444c3ad820527e5fbc099 Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:23.785002 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b'} Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:23.785796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:23.787158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:23.788309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Returning 404 to user: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:23.788309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4fe38356-3f47-473e-86c4-69cdeb268afa tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 404 len: 111 microversion: 2.20 time: 0.030714 Oct 10 12:21:23.788309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 590/1196] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:23 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:21:23.792036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-109a349a-74d9-4a21-9e5c-822d4e18b75c req-109363b6-270b-4ddf-b110-332b352dc92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25", "name": "network-vif-deleted", "tag": "7ba57a2d-ce5e-46be-bfeb-ce6690c962c7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:21:23.801985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-109a349a-74d9-4a21-9e5c-822d4e18b75c req-109363b6-270b-4ddf-b110-332b352dc92d service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:23.803018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-109a349a-74d9-4a21-9e5c-822d4e18b75c req-109363b6-270b-4ddf-b110-332b352dc92d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:23.803018 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-109a349a-74d9-4a21-9e5c-822d4e18b75c req-109363b6-270b-4ddf-b110-332b352dc92d service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.815112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-109a349a-74d9-4a21-9e5c-822d4e18b75c req-109363b6-270b-4ddf-b110-332b352dc92d service nova] Creating event network-vif-deleted:7ba57a2d-ce5e-46be-bfeb-ce6690c962c7 for instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 on hv-cinder-86020 Oct 10 12:21:23.819970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-109a349a-74d9-4a21-9e5c-822d4e18b75c req-109363b6-270b-4ddf-b110-332b352dc92d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033880 Oct 10 12:21:23.820591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 591/1197] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:23.825682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:23.826446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:23.832636 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:23.834884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:23.834884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.834884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:23.834884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:23.835259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:23.969582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:23.977841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3164fa66-6179-4325-86cc-7b7632f8d059 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1682 microversion: 2.1 time: 0.156018 Oct 10 12:21:23.978431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 592/1198] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:23 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:23.983881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a5ac2938-4c1d-4422-ab3b-3ae9e66a956d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '.version_select at 0x7f6d12bed940>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:24.062060 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a5ac2938-4c1d-4422-ab3b-3ae9e66a956d tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073367506" status: 204 len: 0 microversion: 2.20 time: 0.082446 Oct 10 12:21:24.062768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 593/1199] 10.222.0.46 () {60 vars in 1262 bytes} [Mon Oct 10 12:21:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073367506 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 12:21:24.072455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:24.072455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:24.075217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:24.075690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:24.076201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:24.076936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:24.077399 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:24.077834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:24.147545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:24.156140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d4907e3e-c360-43d3-bec9-769e4c9ab10a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1226 microversion: 2.1 time: 0.092327 Oct 10 12:21:24.157816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 594/1200] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:24 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:25.003136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:25.003856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:25.010359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:25.010872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:25.011304 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:25.011992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:25.012441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:25.012926 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:25.150114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:25.158817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fcd9e538-e860-45f2-9060-384f46cec754 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1682 microversion: 2.1 time: 0.159653 Oct 10 12:21:25.159402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 595/1201] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:24 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:21:25.180307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:25.180921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:25.187016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:25.187504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:25.187947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:25.188640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:25.189099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:25.189530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:25.193590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:25.252265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:25.259929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3fb08d0d-1409-4060-b1ac-661cbdb7b160 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1226 microversion: 2.1 time: 0.083275 Oct 10 12:21:25.260439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 596/1202] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:25 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:21:26.182504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:26.183194 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:26.190950 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:26.191439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:26.191874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:26.192573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:26.193024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:26.193450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:26.338528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:26.343590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0005130b-9ffd-452f-b2da-9b574489d1a2 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1682 microversion: 2.1 time: 0.165124 Oct 10 12:21:26.344162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 597/1203] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:26 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:26.348527 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:26.349123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:26.355160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:26.355633 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:26.356066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:26.356762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:26.357921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:26.358357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:26.419876 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:26.427519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-524bb5b3-b04d-4c2f-bc11-e31aab15ad53 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1226 microversion: 2.1 time: 0.082422 Oct 10 12:21:26.428083 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 598/1204] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:26 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:27.368182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:27.368963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:27.376221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:27.376715 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:27.377158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:27.377865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:27.378327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:27.378791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:27.520389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:27.522283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-530e5cf7-b52c-42d6-a60c-84b4cdbc5189 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1682 microversion: 2.1 time: 0.157939 Oct 10 12:21:27.522891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 599/1205] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:27 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:21:27.527326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:27.527930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:27.533790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:27.534271 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:27.534728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:27.535447 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:27.535901 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:27.536325 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:27.601386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:27.609582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1f2e5c78-892a-4ae5-b62d-ae480ec197ec tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1226 microversion: 2.1 time: 0.085671 Oct 10 12:21:27.610687 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 600/1206] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:27 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:28.546276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:28.547028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:28.554153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:28.554632 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:28.555107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:28.555802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:28.556256 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:28.556682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:28.688022 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:28.696556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-62c40c87-c2b9-436e-9b02-504c1ad16d87 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1682 microversion: 2.1 time: 0.154546 Oct 10 12:21:28.697133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 601/1207] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:28 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:21:28.701503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:28.702109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:28.708464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:28.708952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:28.709444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:28.710142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:28.710602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:28.711057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:28.773735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:28.781918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c839dcfe-4501-4ddf-886b-aa68d0fd7573 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1226 microversion: 2.1 time: 0.083794 Oct 10 12:21:28.782503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 602/1208] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:28 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:29.721068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:29.721725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:29.725221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:29.728642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:29.729123 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:29.729554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:29.730249 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:29.730750 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:29.731134 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:29.871391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:29.880080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-48b23e6e-f81d-4239-bb63-503466df40d3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1682 microversion: 2.1 time: 0.163490 Oct 10 12:21:29.880668 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 603/1209] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:29 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:29.885526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:29.886143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:29.892126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:29.892613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:29.893054 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:29.893816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:29.894270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:29.894859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:29.956746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:29.964798 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-349adb5a-dc4a-4450-9ed0-dd9fc6d7dc2a tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1226 microversion: 2.1 time: 0.083153 Oct 10 12:21:29.965375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 604/1210] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:29 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:30.623932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-23ec9b3a-784b-4bce-bfe4-ec6f97eae388 req-f6448faa-2513-460f-89ed-b42f85bd63c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca601f1-e5dc-43b0-91ee-16f03eefb50a", "name": "network-vif-deleted", "tag": "f452dd9a-f82f-4a66-84ef-1b78de8cce04"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:21:30.633955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-23ec9b3a-784b-4bce-bfe4-ec6f97eae388 req-f6448faa-2513-460f-89ed-b42f85bd63c6 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:30.634437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-23ec9b3a-784b-4bce-bfe4-ec6f97eae388 req-f6448faa-2513-460f-89ed-b42f85bd63c6 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:30.634897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-23ec9b3a-784b-4bce-bfe4-ec6f97eae388 req-f6448faa-2513-460f-89ed-b42f85bd63c6 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:30.646918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-23ec9b3a-784b-4bce-bfe4-ec6f97eae388 req-f6448faa-2513-460f-89ed-b42f85bd63c6 service nova] Creating event network-vif-deleted:f452dd9a-f82f-4a66-84ef-1b78de8cce04 for instance eca601f1-e5dc-43b0-91ee-16f03eefb50a on hv-cinder-86020 Oct 10 12:21:30.651984 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-23ec9b3a-784b-4bce-bfe4-ec6f97eae388 req-f6448faa-2513-460f-89ed-b42f85bd63c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Oct 10 12:21:30.652591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 605/1211] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:30.904311 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:30.905017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:30.911918 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:30.912402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:30.912840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:30.913541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:30.913999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:30.914426 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:30.947109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:30.947523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:30.947963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:30.948411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lazy-loading 'fault' on Instance uuid eca601f1-e5dc-43b0-91ee-16f03eefb50a {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:21:30.992213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef422264d0c4a43a0aa1b9eff2251bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab51c9b019e400c8e28d9a789eda6da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:31.000702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3fcc242c-3af8-4a85-80d1-53b36c518d90 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 200 len: 1332 microversion: 2.1 time: 0.101089 Oct 10 12:21:31.011102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 606/1212] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:30 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:31.011102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:31.011102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:31.012732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:31.013223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:31.013668 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:31.014382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:31.014868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:31.015298 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:31.080220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:31.088653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e7e2f740-5a55-44ed-9466-b66273733fde tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1226 microversion: 2.1 time: 0.086258 Oct 10 12:21:31.089413 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 607/1213] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:31 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:32.025209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:32.025982 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:32.033251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.033736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.034180 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.034960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.035393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.035820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.049405 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a HTTP/1.1 Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:32.051067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:32.052759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'eca601f1-e5dc-43b0-91ee-16f03eefb50a'} Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:32.053692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:32.059058 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.060434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:32.060434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6a2da146-06a4-4c3c-8917-6ac3ad2df66d tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 404 len: 111 microversion: 2.1 time: 0.031159 Oct 10 12:21:32.060434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 608/1214] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:32 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:32.060914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2f988a66-a879-42c2-a194-0ad02f8c2282 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '.version_select at 0x7f6d1284c3a0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:32.138567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2f988a66-a879-42c2-a194-0ad02f8c2282 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763038858" status: 202 len: 0 microversion: 2.1 time: 0.081085 Oct 10 12:21:32.139197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 609/1215] 10.222.0.46 () {58 vars in 1221 bytes} [Mon Oct 10 12:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763038858 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:21:32.144287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:32.144923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:32.152801 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.153285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.153740 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.154412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.154894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.155316 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.186244 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.186757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.187191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.190429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lazy-loading 'fault' on Instance uuid 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:21:32.235643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c537b0fefe4fb1b51483ac0e3cf2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26773079b6914a20ab27109b0dec496a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:21:32.243554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-76c7f295-1182-4942-b74a-6b7096ff1a4b tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 200 len: 1231 microversion: 2.1 time: 0.103375 Oct 10 12:21:32.244140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 610/1216] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:32 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:21:32.524396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:32.528772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:32.531252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.531739 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.532199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.532909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.533362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.533879 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.547699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] HTTP exception thrown: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Request method failure captured: Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b HTTP/1.1 Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsfEAnwDHsAhpjCXAfeDuQhWD63I_4Er2RvSbFNdNHOCBiR21CW9DgROmj5QXEnA39MDKjJ9Z5D0GaYVvmxNL__ws5ixHkWkatmgCDTbeUpZwy4Kjj83gAmhXxQHgIbckr4I81Yz_ZyMNM9fY19nGcu3eBcyvrvpvpvJR7WqjjXMQA Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:32.549940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af22e9604d79499aa9b7c2ee3cef156d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: a7a87488f78444c3ad820527e5fbc099 Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.551638 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b'} Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:32.552438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.553665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.555735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Returning 404 to user: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:32.555735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-34ee1e72-1018-4c66-9353-065dbb58d5bd tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 404 len: 111 microversion: 2.20 time: 0.030889 Oct 10 12:21:32.555735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 611/1217] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 10 12:21:32 2022] DELETE /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:21:32.560465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:32.561071 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:32.568223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.568915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.569290 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.570875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:32.570875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:32.571078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:32.585190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] HTTP exception thrown: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Request method failure captured: Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b HTTP/1.1 Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsfEAnwDHsAhpjCXAfeDuQhWD63I_4Er2RvSbFNdNHOCBiR21CW9DgROmj5QXEnA39MDKjJ9Z5D0GaYVvmxNL__ws5ixHkWkatmgCDTbeUpZwy4Kjj83gAmhXxQHgIbckr4I81Yz_ZyMNM9fY19nGcu3eBcyvrvpvpvJR7WqjjXMQA Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:32.587062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af22e9604d79499aa9b7c2ee3cef156d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: a7a87488f78444c3ad820527e5fbc099 Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.588675 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b'} Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:32.589576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. Oct 10 12:21:32.591144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:32.592432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Returning 404 to user: Instance 5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:32.592432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-29e8dda3-99b7-42c9-ad76-0af46d3dbb91 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b" status: 404 len: 111 microversion: 2.20 time: 0.032445 Oct 10 12:21:32.592432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 612/1218] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:32 2022] GET /compute/v2.1/servers/5b1ee2ba-e85f-442c-bab2-3a36f2cdb95b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:21:33.266794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:33.268212 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:33.275026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.275517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.275988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:33.276742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.277149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.277575 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:33.291908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] HTTP exception thrown: Instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 could not be found. Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Request method failure captured: Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 HTTP/1.1 Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAumOyQtgCSkjkt7yWBZ8BWxFImr9O1X5rNnXVoDcMBBghy_lnU6vaXH-HjGnDJp-RgVy_uf8g8v9PlerPbz1109H9dZmz4gCMpNQZDufUr9U6JmuVlw_ovaADxTK6m7ljddfrUBjzJQ_rLuWblCqKCTN34xt2OuQCU2BCSDXzekEo4 Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:33.293586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26773079b6914a20ab27109b0dec496a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26773079b6914a20ab27109b0dec496a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 21c537b0fefe4fb1b51483ac0e3cf2d1 Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 could not be found. Oct 10 12:21:33.295195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25'} Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 could not be found. Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:33.296088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 could not be found. Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 could not be found. Oct 10 12:21:33.297464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.299277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Returning 404 to user: Instance 2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:33.299277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1ac6275a-df99-4f30-aa07-c3a871e0fe03 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25" status: 404 len: 111 microversion: 2.1 time: 0.032280 Oct 10 12:21:33.299277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 613/1219] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:33 2022] GET /compute/v2.1/servers/2b7f8fb6-9dfe-4e77-b551-601c1dcf3f25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:33.893076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:33.893723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:33.899907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.901991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.901991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:33.901991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.901991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.902481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:33.918148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] HTTP exception thrown: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Request method failure captured: Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 HTTP/1.1 Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAumOyQtgCSkjkt7yWBZ8BWxFImr9O1X5rNnXVoDcMBBghy_lnU6vaXH-HjGnDJp-RgVy_uf8g8v9PlerPbz1109H9dZmz4gCMpNQZDufUr9U6JmuVlw_ovaADxTK6m7ljddfrUBjzJQ_rLuWblCqKCTN34xt2OuQCU2BCSDXzekEo4 Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:33.919807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26773079b6914a20ab27109b0dec496a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26773079b6914a20ab27109b0dec496a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 21c537b0fefe4fb1b51483ac0e3cf2d1 Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.921333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '9f92846d-2cb9-4e32-ae7a-a5a7d775bc36'} Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:33.922193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.924209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.925646 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Returning 404 to user: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:33.925646 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ccdd8082-7d1a-48b7-8037-70c04b5aff3c tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 404 len: 111 microversion: 2.1 time: 0.032126 Oct 10 12:21:33.925646 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 614/1220] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:21:33 2022] DELETE /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:33.930660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:33.931373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] [instance: 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:33.937522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.938016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.938860 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:33.939591 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.940048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.940474 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:33.957592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] HTTP exception thrown: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Request method failure captured: Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 HTTP/1.1 Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAumOyQtgCSkjkt7yWBZ8BWxFImr9O1X5rNnXVoDcMBBghy_lnU6vaXH-HjGnDJp-RgVy_uf8g8v9PlerPbz1109H9dZmz4gCMpNQZDufUr9U6JmuVlw_ovaADxTK6m7ljddfrUBjzJQ_rLuWblCqKCTN34xt2OuQCU2BCSDXzekEo4 Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:33.959182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26773079b6914a20ab27109b0dec496a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26773079b6914a20ab27109b0dec496a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26773079b6914a20ab27109b0dec496a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 26773079b6914a20ab27109b0dec496a Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-TestVolumeBootPattern-555404953 Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 21c537b0fefe4fb1b51483ac0e3cf2d1 Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-TestVolumeBootPattern-555404953-project Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.960745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '9f92846d-2cb9-4e32-ae7a-a5a7d775bc36'} Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:33.962349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. Oct 10 12:21:33.966109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:33.967332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Returning 404 to user: Instance 9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:33.967332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-83d5f33a-2417-4282-87d8-089f938ac94d tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36" status: 404 len: 111 microversion: 2.1 time: 0.033772 Oct 10 12:21:33.967332 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 615/1221] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:33 2022] GET /compute/v2.1/servers/9f92846d-2cb9-4e32-ae7a-a5a7d775bc36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:21:33.980661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:33.981234 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:33.988243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.988742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.989248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:33.990099 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:33.990661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:33.991189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:34.005988 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] HTTP exception thrown: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Request method failure captured: Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 HTTP/1.1 Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsfEAnwDHsAhpjCXAfeDuQhWD63I_4Er2RvSbFNdNHOCBiR21CW9DgROmj5QXEnA39MDKjJ9Z5D0GaYVvmxNL__ws5ixHkWkatmgCDTbeUpZwy4Kjj83gAmhXxQHgIbckr4I81Yz_ZyMNM9fY19nGcu3eBcyvrvpvpvJR7WqjjXMQA Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:34.007651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af22e9604d79499aa9b7c2ee3cef156d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: a7a87488f78444c3ad820527e5fbc099 Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.009514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '3e51573a-beab-4197-840e-a9427a52e273'} Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:34.010694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.012181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.013843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Returning 404 to user: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:34.013843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6cc27df1-b1c0-4459-884c-f30331474cbc tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 404 len: 111 microversion: 2.20 time: 0.032724 Oct 10 12:21:34.013843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 616/1222] 10.222.0.46 () {60 vars in 1280 bytes} [Mon Oct 10 12:21:33 2022] DELETE /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 12:21:34.018225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:34.018859 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] [instance: 3e51573a-beab-4197-840e-a9427a52e273] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:34.024942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:34.025428 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:34.025866 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:34.026560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:34.027056 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:34.027483 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:34.041616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] HTTP exception thrown: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Request method failure captured: Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 HTTP/1.1 Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsfEAnwDHsAhpjCXAfeDuQhWD63I_4Er2RvSbFNdNHOCBiR21CW9DgROmj5QXEnA39MDKjJ9Z5D0GaYVvmxNL__ws5ixHkWkatmgCDTbeUpZwy4Kjj83gAmhXxQHgIbckr4I81Yz_ZyMNM9fY19nGcu3eBcyvrvpvpvJR7WqjjXMQA Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:34.043188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af22e9604d79499aa9b7c2ee3cef156d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af22e9604d79499aa9b7c2ee3cef156d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: af22e9604d79499aa9b7c2ee3cef156d Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663772450 Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: a7a87488f78444c3ad820527e5fbc099 Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663772450-project Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.044893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '3e51573a-beab-4197-840e-a9427a52e273'} Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:34.049881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. Oct 10 12:21:34.051806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.053078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] Returning 404 to user: Instance 3e51573a-beab-4197-840e-a9427a52e273 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:34.053078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d3349c2f-7a33-4c49-8999-da9c29f1e469 tempest-AttachVolumeShelveTestJSON-1663772450 tempest-AttachVolumeShelveTestJSON-1663772450-project] 10.222.0.46 "GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273" status: 404 len: 111 microversion: 2.20 time: 0.030122 Oct 10 12:21:34.053078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 617/1223] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Oct 10 12:21:34 2022] GET /compute/v2.1/servers/3e51573a-beab-4197-840e-a9427a52e273 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 12:21:34.309060 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:34.309746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:34.316402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:34.316893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:34.317327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:34.318218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:34.318721 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:34.319153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:34.334217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a HTTP/1.1 Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:34.335814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.337802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'eca601f1-e5dc-43b0-91ee-16f03eefb50a'} Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:34.338617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.340565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.342114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:34.342114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6d526459-beff-43c4-88b8-8a88abf1450c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 404 len: 111 microversion: 2.1 time: 0.032462 Oct 10 12:21:34.342114 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 618/1224] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:21:34 2022] DELETE /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:34.346929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:34.347620 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: eca601f1-e5dc-43b0-91ee-16f03eefb50a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:34.353783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:34.354279 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:34.354749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:34.355446 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:34.356598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:34.356598 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:34.372129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a HTTP/1.1 Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:34.373813 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.375193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'eca601f1-e5dc-43b0-91ee-16f03eefb50a'} Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:34.376011 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. Oct 10 12:21:34.378207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:34.379582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance eca601f1-e5dc-43b0-91ee-16f03eefb50a could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:34.379582 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c65d9c31-fe37-4b5c-b0cd-2e203e3ef591 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a" status: 404 len: 111 microversion: 2.1 time: 0.032806 Oct 10 12:21:34.379944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 619/1225] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:34 2022] GET /compute/v2.1/servers/eca601f1-e5dc-43b0-91ee-16f03eefb50a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:21:35.583260 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3bb5e67d-ac5e-4a5e-8dad-57fb95c39257 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] Calling method '.version_select at 0x7f6d12aaaee0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:35.716247 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3bb5e67d-ac5e-4a5e-8dad-57fb95c39257 tempest-TestVolumeBootPattern-555404953 tempest-TestVolumeBootPattern-555404953-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1382985420" status: 202 len: 0 microversion: 2.1 time: 0.137420 Oct 10 12:21:35.716840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 620/1226] 10.222.0.46 () {58 vars in 1263 bytes} [Mon Oct 10 12:21:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1382985420 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:21:35.811940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:35.817713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:35.821464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.821893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.822565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.823953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.824569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.824997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.844517 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 HTTP/1.1 Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:35.846989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.848395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '1476dd01-f830-450e-a00a-4e4c54345b44'} Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:35.849186 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.850358 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.858491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:35.858491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-91c14a42-02b6-4b1c-bd04-3860a1f8560f tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 404 len: 111 microversion: 2.1 time: 0.040695 Oct 10 12:21:35.858491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 621/1227] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:21:35 2022] DELETE /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:35.865023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:35.866033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 1476dd01-f830-450e-a00a-4e4c54345b44] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:35.872989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.873592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.874094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.875045 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.875885 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.876924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.881708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:35.892791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 HTTP/1.1 Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:35.894344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.895980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '1476dd01-f830-450e-a00a-4e4c54345b44'} Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:35.896737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. Oct 10 12:21:35.901946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.907627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance 1476dd01-f830-450e-a00a-4e4c54345b44 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:35.907627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3e2b6b27-4e5d-43c8-ad1b-2a843ed8427c tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44" status: 404 len: 111 microversion: 2.1 time: 0.041734 Oct 10 12:21:35.907627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 622/1228] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:35 2022] GET /compute/v2.1/servers/1476dd01-f830-450e-a00a-4e4c54345b44 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:21:35.907627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:35.907627 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:35.912172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.912678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.913371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.914292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.914292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.914772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.930385 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 HTTP/1.1 Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:35.932278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.933878 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'd0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3'} Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:35.934644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.936025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.937457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:35.937457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fa983622-9959-4038-96e2-4f28604f29a3 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 404 len: 111 microversion: 2.1 time: 0.033242 Oct 10 12:21:35.937457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 623/1229] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:21:35 2022] DELETE /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:35.942992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:35.943606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:35.949739 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.950221 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.950653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.951407 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:35.951855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:35.952274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:35.969309 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 HTTP/1.1 Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:35.971478 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.973140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'd0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3'} Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:35.974189 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. Oct 10 12:21:35.975661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:35.976898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:35.976898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c0d69305-9f4b-438b-a7bf-7e165a7c3bad tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3" status: 404 len: 111 microversion: 2.1 time: 0.034443 Oct 10 12:21:35.976898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 624/1230] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:35 2022] GET /compute/v2.1/servers/d0e4bed1-3f39-47a3-9bb3-3eb9781a9ff3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:21:37.308857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:37.310167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:37.322899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:37.324980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:37.325906 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:37.326637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:37.327299 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:37.327729 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:37.360225 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a HTTP/1.1 Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:37.362414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.364073 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '2bb9c640-3e33-4e42-a21e-cdcce980b06a'} Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:37.364944 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.366423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.374526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:37.383403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-07812ebd-291d-4f3e-b05d-d756a662ced5 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 404 len: 111 microversion: 2.1 time: 0.078977 Oct 10 12:21:37.387388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 625/1231] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:21:37 2022] DELETE /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:37.392708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:37.393409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] [instance: 2bb9c640-3e33-4e42-a21e-cdcce980b06a] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:21:37.399938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:37.400522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:37.401163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:37.402082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:21:37.402799 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:21:37.403536 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:21:37.425782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] HTTP exception thrown: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Request method failure captured: Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a HTTP/1.1 Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRAsbR3a8C_tg-j3UjEyVPzr8BjxXjwkVRn6RQ2E794m1LyX5zgULnjZ3V-4JrbXt30xoyRWpt-6S6g_JT1yf9LTa4X_yMQaXfMGJJ1RGIu2AxmF2doCe2XwTgMG4-vzOKm9qaSqyCDyw5Z5qvrQw5cbt60bLmKk-5Odz_lkoYFXCAEI Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:37.429376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aab51c9b019e400c8e28d9a789eda6da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aab51c9b019e400c8e28d9a789eda6da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: aab51c9b019e400c8e28d9a789eda6da Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1666485525 Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: fef422264d0c4a43a0aa1b9eff2251bd Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-AttachVolumeNegativeTest-1666485525-project Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.433919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '2bb9c640-3e33-4e42-a21e-cdcce980b06a'} Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:37.434907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. Oct 10 12:21:37.436378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:37.437888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] Returning 404 to user: Instance 2bb9c640-3e33-4e42-a21e-cdcce980b06a could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:37.437888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-442fe433-31d1-4900-8065-aad5f05d2e93 tempest-AttachVolumeNegativeTest-1666485525 tempest-AttachVolumeNegativeTest-1666485525-project] 10.222.0.46 "GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a" status: 404 len: 111 microversion: 2.1 time: 0.042542 Oct 10 12:21:37.443227 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 626/1232] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:21:37 2022] GET /compute/v2.1/servers/2bb9c640-3e33-4e42-a21e-cdcce980b06a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 12:21:43.695023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:21:43.695583 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:21:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:21:43.697819 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:21:43.698066 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:21:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:21:44.925476 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4ca4fc04-7214-43ac-8530-693a6c1db9f3 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Action: 'create', calling method: .version_select at 0x7f6d12e55d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-392199906"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:21:45.759343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4ca4fc04-7214-43ac-8530-693a6c1db9f3 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.973451 Oct 10 12:21:45.759997 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 627/1233] 10.222.0.46 () {60 vars in 1155 bytes} [Mon Oct 10 12:21:44 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 975 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 10 12:21:45.774399 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-72e6dabe-c017-4aea-b909-63f924321c63 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d129ce550>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:45.837192 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-72e6dabe-c017-4aea-b909-63f924321c63 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44" status: 200 len: 344 microversion: 2.1 time: 0.067153 Oct 10 12:21:45.837773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 628/1234] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:21:45 2022] GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:46.852317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5c48e6f1-d4ac-4044-a546-6b3783701fb1 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d1298b430>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:46.903673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5c48e6f1-d4ac-4044-a546-6b3783701fb1 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44" status: 200 len: 345 microversion: 2.1 time: 0.056043 Oct 10 12:21:46.904542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 629/1235] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:21:46 2022] GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:46.917964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-42adc46b-a9aa-41bc-ac59-696dd8349b39 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Action: 'create', calling method: .version_select at 0x7f6d129ce040>, body: {"snapshot": {"volume_id": "f46f3ac3-bf48-49b4-b4d6-450edcb58c44", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1895444094"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:21:47.397468 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:47.410762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=8 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:47.549139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-42adc46b-a9aa-41bc-ac59-696dd8349b39 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.634941 Oct 10 12:21:47.550037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 630/1236] 10.222.0.46 () {60 vars in 1162 bytes} [Mon Oct 10 12:21:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:47.577702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b146ee00-1cd2-4afd-8e00-6166615f2729 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12b01dc0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:47.613376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b146ee00-1cd2-4afd-8e00-6166615f2729 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 287 microversion: 2.1 time: 0.054670 Oct 10 12:21:47.614324 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 631/1237] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:47 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:47.626558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6ae3d3ca-e390-47d5-be76-d03317f631dc tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12ceedc0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:47.663741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6ae3d3ca-e390-47d5-be76-d03317f631dc tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041648 Oct 10 12:21:47.670156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 632/1238] 10.222.0.46 () {58 vars in 1140 bytes} [Mon Oct 10 12:21:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:47.676040 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9df095bd-b76b-49ff-bf23-f505ee2cb6e4 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12aaa280>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:47.707086 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9df095bd-b76b-49ff-bf23-f505ee2cb6e4 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 287 microversion: 2.1 time: 0.034931 Oct 10 12:21:47.707662 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 633/1239] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:47 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:48.721493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-158b6d05-ffe8-4aef-80be-81d19ca0c091 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12b01dc0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:48.757651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-158b6d05-ffe8-4aef-80be-81d19ca0c091 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 287 microversion: 2.1 time: 0.041107 Oct 10 12:21:48.758414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 634/1240] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:48 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:49.771493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-26b5f308-3f1a-4d25-95f1-a851516e9f6b tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d129ce790>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:49.803095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-26b5f308-3f1a-4d25-95f1-a851516e9f6b tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 287 microversion: 2.1 time: 0.036650 Oct 10 12:21:49.803999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 635/1241] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:49 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:50.817475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d221b446-a93f-4629-99b0-bdab06f9d645 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12d13f70>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:50.846959 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d221b446-a93f-4629-99b0-bdab06f9d645 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 287 microversion: 2.1 time: 0.034288 Oct 10 12:21:50.853922 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 636/1242] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:50 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:51.862426 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dcf42b7a-8e2d-4d46-a28a-0713f2204257 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12aaa040>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:51.895441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dcf42b7a-8e2d-4d46-a28a-0713f2204257 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 287 microversion: 2.1 time: 0.039052 Oct 10 12:21:51.896129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 637/1243] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:51 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:52.908910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-772168f7-e69d-4d8d-8119-79001627e9c2 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12bed160>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:52.948629 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-772168f7-e69d-4d8d-8119-79001627e9c2 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 288 microversion: 2.1 time: 0.043942 Oct 10 12:21:52.949206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 638/1244] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:52 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 288 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:52.960521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-44e97c9a-a07c-4c53-bea6-b34dbfb7a7a9 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d129ce1f0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:53.121615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-44e97c9a-a07c-4c53-bea6-b34dbfb7a7a9 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 202 len: 0 microversion: 2.1 time: 0.164942 Oct 10 12:21:53.122231 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 639/1245] 10.222.0.46 () {58 vars in 1254 bytes} [Mon Oct 10 12:21:52 2022] DELETE /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:21:53.130854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-60cb411b-b76e-4032-bdf7-07966d259de8 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12aaac10>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:53.166398 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-60cb411b-b76e-4032-bdf7-07966d259de8 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 200 len: 287 microversion: 2.1 time: 0.039286 Oct 10 12:21:53.167021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 640/1246] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:53 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:21:54.179670 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-28c75fb2-8f02-453d-a1f4-6e4440c5570c tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12a4e670>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:54.206765 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-28c75fb2-8f02-453d-a1f4-6e4440c5570c tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] HTTP exception thrown: Snapshot 48444d0a-3d03-4f57-a70e-6a239508f82a could not be found. Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-28c75fb2-8f02-453d-a1f4-6e4440c5570c tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Request method failure captured: Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a HTTP/1.1 Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA5Y2gx68S6hEa4snMUCoj7qleaZSXn6U65hJRoQmFRKqDRDR8D_DicAoXVCb5ppMe7h3AOQ_6Mu8w8RH9M94anB-nXYVfBSVO3f2cMjmzbrbGIbCowmXDw99FryMNRfvAv6JP0Hbhh-Y7ut2Efu7SzdvvOh9-izl1zp3DUEOOCfhgc Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:54.209171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4bd4f7bcd357441185ee61871404c84b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: ab50583207134c8fa2026cc245d252c2 Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Snapshot 48444d0a-3d03-4f57-a70e-6a239508f82a could not be found. Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '48444d0a-3d03-4f57-a70e-6a239508f82a'} Oct 10 12:21:54.211411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 48444d0a-3d03-4f57-a70e-6a239508f82a could not be found. (HTTP 404) (Request-ID: req-1b86b53e-2d65-4465-bfa3-79ec09c3a8b2) Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:54.212467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:21:54.213790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 48444d0a-3d03-4f57-a70e-6a239508f82a could not be found. Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 10 12:21:54.222171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 48444d0a-3d03-4f57-a70e-6a239508f82a could not be found. Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 48444d0a-3d03-4f57-a70e-6a239508f82a could not be found. Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-28c75fb2-8f02-453d-a1f4-6e4440c5570c tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Returning 404 to user: Snapshot 48444d0a-3d03-4f57-a70e-6a239508f82a could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:54.223661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-28c75fb2-8f02-453d-a1f4-6e4440c5570c tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a" status: 404 len: 111 microversion: 2.1 time: 0.035413 Oct 10 12:21:54.224688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 641/1247] 10.222.0.46 () {58 vars in 1251 bytes} [Mon Oct 10 12:21:54 2022] GET /compute/v2.1/os-snapshots/48444d0a-3d03-4f57-a70e-6a239508f82a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:54.224688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fad8e9cd-db09-4290-961b-fb511d1d1705 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d129ce4c0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:54.426926 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fad8e9cd-db09-4290-961b-fb511d1d1705 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44" status: 202 len: 0 microversion: 2.1 time: 0.211020 Oct 10 12:21:54.427653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 642/1248] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:21:54 2022] DELETE /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:21:54.435824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-115f2376-c97c-4733-a0c3-21f9c80a66aa tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d12bed430>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:54.521242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-115f2376-c97c-4733-a0c3-21f9c80a66aa tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44" status: 200 len: 344 microversion: 2.1 time: 0.089110 Oct 10 12:21:54.522313 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 643/1249] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:21:54 2022] GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:21:55.536990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f6fce553-4d27-4134-bac1-906f5f6b96c7 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d1298bca0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:55.566050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-f6fce553-4d27-4134-bac1-906f5f6b96c7 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] HTTP exception thrown: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f6fce553-4d27-4134-bac1-906f5f6b96c7 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Request method failure captured: Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 HTTP/1.1 Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA5Y2gx68S6hEa4snMUCoj7qleaZSXn6U65hJRoQmFRKqDRDR8D_DicAoXVCb5ppMe7h3AOQ_6Mu8w8RH9M94anB-nXYVfBSVO3f2cMjmzbrbGIbCowmXDw99FryMNRfvAv6JP0Hbhh-Y7ut2Efu7SzdvvOh9-izl1zp3DUEOOCfhgc Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:55.568012 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4bd4f7bcd357441185ee61871404c84b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: ab50583207134c8fa2026cc245d252c2 Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'f46f3ac3-bf48-49b4-b4d6-450edcb58c44'} Oct 10 12:21:55.569384 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. (HTTP 404) (Request-ID: req-ba08e55d-4ca7-4fa3-98ad-5476859d60f7) Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.570892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:21:55.572211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 12:21:55.576890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f6fce553-4d27-4134-bac1-906f5f6b96c7 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Returning 404 to user: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f6fce553-4d27-4134-bac1-906f5f6b96c7 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44" status: 404 len: 109 microversion: 2.1 time: 0.037403 Oct 10 12:21:55.580137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 644/1250] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:21:55 2022] GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:55.586181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dc9eb90c-ff6a-45f7-a3ba-79577cc3268e tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d129cee50>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:55.654230 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-dc9eb90c-ff6a-45f7-a3ba-79577cc3268e tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] HTTP exception thrown: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dc9eb90c-ff6a-45f7-a3ba-79577cc3268e tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Request method failure captured: Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 HTTP/1.1 Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA5Y2gx68S6hEa4snMUCoj7qleaZSXn6U65hJRoQmFRKqDRDR8D_DicAoXVCb5ppMe7h3AOQ_6Mu8w8RH9M94anB-nXYVfBSVO3f2cMjmzbrbGIbCowmXDw99FryMNRfvAv6JP0Hbhh-Y7ut2Efu7SzdvvOh9-izl1zp3DUEOOCfhgc Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:55.656206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4bd4f7bcd357441185ee61871404c84b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: ab50583207134c8fa2026cc245d252c2 Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'f46f3ac3-bf48-49b4-b4d6-450edcb58c44'} Oct 10 12:21:55.661651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. (HTTP 404) (Request-ID: req-ed812f37-6247-4b3d-8df7-7f3c1beefa1a) Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.662571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 12:21:55.663940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 12:21:55.665287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dc9eb90c-ff6a-45f7-a3ba-79577cc3268e tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Returning 404 to user: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:55.666708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dc9eb90c-ff6a-45f7-a3ba-79577cc3268e tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44" status: 404 len: 109 microversion: 2.1 time: 0.080546 Oct 10 12:21:55.667788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 645/1251] 10.222.0.46 () {58 vars in 1248 bytes} [Mon Oct 10 12:21:55 2022] DELETE /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:55.669696 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1a623a10-c6c9-4295-ae40-2b2fd839a102 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Calling method '.version_select at 0x7f6d128f6280>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:21:55.698909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-1a623a10-c6c9-4295-ae40-2b2fd839a102 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] HTTP exception thrown: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1a623a10-c6c9-4295-ae40-2b2fd839a102 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Request method failure captured: Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 HTTP/1.1 Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA5Y2gx68S6hEa4snMUCoj7qleaZSXn6U65hJRoQmFRKqDRDR8D_DicAoXVCb5ppMe7h3AOQ_6Mu8w8RH9M94anB-nXYVfBSVO3f2cMjmzbrbGIbCowmXDw99FryMNRfvAv6JP0Hbhh-Y7ut2Efu7SzdvvOh9-izl1zp3DUEOOCfhgc Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:21:55.700952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4bd4f7bcd357441185ee61871404c84b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4bd4f7bcd357441185ee61871404c84b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 4bd4f7bcd357441185ee61871404c84b Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066165511 Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: ab50583207134c8fa2026cc245d252c2 Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066165511-project Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': 'f46f3ac3-bf48-49b4-b4d6-450edcb58c44'} Oct 10 12:21:55.702560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. (HTTP 404) (Request-ID: req-df8a220a-11d9-4c26-9aee-04520df8aff7) Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.704904 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 12:21:55.706132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 12:21:55.707952 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1a623a10-c6c9-4295-ae40-2b2fd839a102 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] Returning 404 to user: Volume f46f3ac3-bf48-49b4-b4d6-450edcb58c44 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1a623a10-c6c9-4295-ae40-2b2fd839a102 tempest-VolumesSnapshotsTestJSON-1066165511 tempest-VolumesSnapshotsTestJSON-1066165511-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44" status: 404 len: 109 microversion: 2.1 time: 0.039488 Oct 10 12:21:55.710035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 646/1252] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:21:55 2022] GET /compute/v2.1/os-volumes/f46f3ac3-bf48-49b4-b4d6-450edcb58c44 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:22:00.794686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d471d826-af9d-433d-8331-6fc71c9cbf37 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d1298b1f0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:00.844003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d471d826-af9d-433d-8331-6fc71c9cbf37 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/5a763a4c-d4f9-4bb1-a71a-7b24f6c3463f" status: 200 len: 351 microversion: 2.1 time: 0.053583 Oct 10 12:22:00.844669 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 647/1253] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:22:00 2022] GET /compute/v2.1/os-volumes/5a763a4c-d4f9-4bb1-a71a-7b24f6c3463f => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:03.531431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-952931694", "imageRef": "6644679a-a968-4bca-9e67-b7870748f510", "flavorRef": "452"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:22:03.598781 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] validate_networks() for None {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:22:03.882333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:22:03.882770 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:22:03.883241 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:22:03.883645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:22:03.884052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:22:03.894406 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:03.894914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:03.895968 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:03.896701 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:03.897207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:03.897625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:03.914009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Getting quotas for project 931d44e7d8c84dad9aa3c64eafd899d8. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:22:03.917919 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Getting quotas for user edddd32b0093470482df3491ed69ad6c and project 931d44e7d8c84dad9aa3c64eafd899d8. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:22:03.929077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:22:03.931367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6644679a-a968-4bca-9e67-b7870748f510',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:22:04.058496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ddfbc963-9816-4bfb-957c-a1d8d5c6bf6a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532019 Oct 10 12:22:04.059195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 648/1254] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:22:04.065718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-90d6e1ce-500a-45b1-82c3-96440e1204d6 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d12aaadc0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:04.118374 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-90d6e1ce-500a-45b1-82c3-96440e1204d6 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0c911d2b-7343-4f6d-8407-ea50797dee52" status: 200 len: 350 microversion: 2.1 time: 0.058127 Oct 10 12:22:04.119036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 649/1255] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:22:04 2022] GET /compute/v2.1/os-volumes/0c911d2b-7343-4f6d-8407-ea50797dee52 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:22:04.123573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bac6bcbc-2ad7-46e9-9549-764d198ce27c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:04.124187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bac6bcbc-2ad7-46e9-9549-764d198ce27c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:04.186993 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bac6bcbc-2ad7-46e9-9549-764d198ce27c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:04.194643 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bac6bcbc-2ad7-46e9-9549-764d198ce27c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1214 microversion: 2.1 time: 0.074622 Oct 10 12:22:04.198983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 650/1256] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:04 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:22:05.220855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-de217986-30cc-438b-8694-24f6affde3d1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:05.221538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-de217986-30cc-438b-8694-24f6affde3d1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:05.278342 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-de217986-30cc-438b-8694-24f6affde3d1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:05.282923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-de217986-30cc-438b-8694-24f6affde3d1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1214 microversion: 2.1 time: 0.065940 Oct 10 12:22:05.283497 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 651/1257] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:05 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:06.306213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:06.307181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:06.314507 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:06.315025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:06.315469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:06.317513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:06.317513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:06.317513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:06.393644 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:06.402106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c31a9049-6314-4f3c-af8e-c72983f57ce0 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1266 microversion: 2.1 time: 0.100371 Oct 10 12:22:06.405655 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 652/1258] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:06 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:22:06.910282 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-05157c52-0c7d-4c76-b5d3-08ccb8bb1d71 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d16206b80>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:06.961611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-05157c52-0c7d-4c76-b5d3-08ccb8bb1d71 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/1a12551d-2fd4-4a05-a21b-083354ebe724" status: 200 len: 351 microversion: 2.1 time: 0.054965 Oct 10 12:22:06.962197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 653/1259] 10.222.0.46 () {58 vars in 1245 bytes} [Mon Oct 10 12:22:06 2022] GET /compute/v2.1/os-volumes/1a12551d-2fd4-4a05-a21b-083354ebe724 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:06.976004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c9b17061-76ce-416d-976c-218479ae8371 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d162060d0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.070046 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c9b17061-76ce-416d-976c-218479ae8371 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.098492 Oct 10 12:22:07.070836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 654/1260] 10.222.0.46 () {58 vars in 1134 bytes} [Mon Oct 10 12:22:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:07.096546 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a34f4059-c79f-4056-8a55-15bab3c7f4d2 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d12beddc0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.187802 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a34f4059-c79f-4056-8a55-15bab3c7f4d2 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.106624 Oct 10 12:22:07.188396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 655/1261] 10.222.0.46 () {58 vars in 1149 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:07.202174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2112fae5-1ced-4a1a-913a-8a1c0be876e5 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d1284c940>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.286510 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2112fae5-1ced-4a1a-913a-8a1c0be876e5 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088022 Oct 10 12:22:07.287139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 656/1262] 10.222.0.46 () {58 vars in 1134 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:07.300767 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1f96d379-f516-4fe2-926e-c13cbf377e13 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d1296d280>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.387637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1f96d379-f516-4fe2-926e-c13cbf377e13 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090339 Oct 10 12:22:07.390707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 657/1263] 10.222.0.46 () {58 vars in 1167 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:07.405098 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-390b77a1-2804-4729-aa4b-d1ff64e6457a tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d162065e0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.493475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-390b77a1-2804-4729-aa4b-d1ff64e6457a tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092695 Oct 10 12:22:07.494136 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 658/1264] 10.222.0.46 () {58 vars in 1170 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:07.500024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.500966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:07.508285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:07.509244 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:07.510173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:07.511004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:07.511801 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:07.512290 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:07.576681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:07.584741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7fcb6fbd-65a8-4b61-b549-73a6ad773192 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1272 microversion: 2.1 time: 0.088905 Oct 10 12:22:07.585320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 659/1265] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:22:07.590055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3b88d7d1-97ba-421b-8aaa-9e492a1a52b2 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d12a4e790>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.676814 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3b88d7d1-97ba-421b-8aaa-9e492a1a52b2 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090184 Oct 10 12:22:07.677392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 660/1266] 10.222.0.46 () {58 vars in 1155 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:22:07.690685 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-88f736c5-4408-4c18-bd0d-4b217a5f3667 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d12aaaa60>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.773667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-88f736c5-4408-4c18-bd0d-4b217a5f3667 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086629 Oct 10 12:22:07.774303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 661/1267] 10.222.0.46 () {58 vars in 1188 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:07.788702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1996d2d1-ba60-4d6a-895f-a83e382f5d44 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] Calling method '.version_select at 0x7f6d12ceeca0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:07.876455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1996d2d1-ba60-4d6a-895f-a83e382f5d44 tempest-VolumesTestJSON-1299251006 tempest-VolumesTestJSON-1299251006-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092223 Oct 10 12:22:07.877033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 662/1268] 10.222.0.46 () {58 vars in 1155 bytes} [Mon Oct 10 12:22:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:08.609943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:08.610775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:08.617924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:08.618423 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:08.619243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:08.620178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:08.620942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:08.621690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:08.759280 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:08.767966 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b8ab2248-9e13-45c6-b757-915f84788f78 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.163210 Oct 10 12:22:08.768694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 663/1269] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:08 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:08.922348 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-010e60de-0bfc-4930-91e9-8885fc64296a req-cee87382-fd19-4b13-a79f-d16649667a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee45b48-6e03-4f6b-bb8e-e63251532a27", "tag": "26fd7740-60c2-4f85-8fee-7642937d7612"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:22:08.933788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-010e60de-0bfc-4930-91e9-8885fc64296a req-cee87382-fd19-4b13-a79f-d16649667a2e service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:08.934276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-010e60de-0bfc-4930-91e9-8885fc64296a req-cee87382-fd19-4b13-a79f-d16649667a2e service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:08.934746 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-010e60de-0bfc-4930-91e9-8885fc64296a req-cee87382-fd19-4b13-a79f-d16649667a2e service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:08.949975 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-010e60de-0bfc-4930-91e9-8885fc64296a req-cee87382-fd19-4b13-a79f-d16649667a2e service nova] Creating event network-changed:26fd7740-60c2-4f85-8fee-7642937d7612 for instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 on hv-cinder-86020 Oct 10 12:22:08.955833 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-010e60de-0bfc-4930-91e9-8885fc64296a req-cee87382-fd19-4b13-a79f-d16649667a2e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038107 Oct 10 12:22:08.956613 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 664/1270] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:09.797253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:09.797253 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:09.802443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:09.803013 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:09.803445 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:09.804835 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:09.805301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:09.805723 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:09.943106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:09.950986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-78f1b009-0880-4760-94de-64188590c269 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.161603 Oct 10 12:22:09.953566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 665/1271] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:09 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:10.974301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:10.974976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:10.981462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:10.981935 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:10.982366 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:10.983075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:10.983520 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:10.983937 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:11.119037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:11.126749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9a825347-8c8a-49bd-9281-2994d31091f4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.156277 Oct 10 12:22:11.127310 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 666/1272] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:10 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:12.154439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:12.156777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:12.167143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:12.167964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:12.168672 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:12.169635 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:12.170549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:12.171295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:12.317825 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:12.326547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fe7587c2-96ef-47eb-99c1-e137621c7f2a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.180794 Oct 10 12:22:12.327316 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 667/1273] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:12 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:22:13.349236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:13.349921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:13.356667 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:13.357140 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:13.357569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:13.358248 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:13.358714 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:13.359133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:13.492651 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:13.500558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-374aaef3-5d0b-4b3c-9ef0-e17058d3d1e4 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.155118 Oct 10 12:22:13.501131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 668/1274] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:13 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:14.523804 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:14.524551 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:14.526604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:22:14.535716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:14.535716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:14.535716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:14.535716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:14.536097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:14.536097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:14.688244 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:14.696232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8f196559-054e-41d6-97cc-24f48694bc75 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.176485 Oct 10 12:22:14.696809 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 669/1275] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:14 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:15.720160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:15.720847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:15.722632 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=10 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:22:15.728010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:15.728491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:15.728930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:15.729622 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:15.730111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:15.730556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:15.866716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:15.875113 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-df02d001-88f9-4602-b0a9-77b5fd211134 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.158873 Oct 10 12:22:15.875695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 670/1276] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:15 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:16.007363 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-ba2b60c7-7062-4a20-82ff-bbc3b599f74e req-b777c06a-1b39-40d0-8cca-3888dd0b69cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee45b48-6e03-4f6b-bb8e-e63251532a27", "name": "network-vif-plugged", "status": "completed", "tag": "26fd7740-60c2-4f85-8fee-7642937d7612"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:22:16.018361 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-ba2b60c7-7062-4a20-82ff-bbc3b599f74e req-b777c06a-1b39-40d0-8cca-3888dd0b69cc service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:16.018895 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-ba2b60c7-7062-4a20-82ff-bbc3b599f74e req-b777c06a-1b39-40d0-8cca-3888dd0b69cc service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:16.019333 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-ba2b60c7-7062-4a20-82ff-bbc3b599f74e req-b777c06a-1b39-40d0-8cca-3888dd0b69cc service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:16.030946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-ba2b60c7-7062-4a20-82ff-bbc3b599f74e req-b777c06a-1b39-40d0-8cca-3888dd0b69cc service nova] Creating event network-vif-plugged:26fd7740-60c2-4f85-8fee-7642937d7612 for instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 on hv-cinder-86020 Oct 10 12:22:16.036187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-ba2b60c7-7062-4a20-82ff-bbc3b599f74e req-b777c06a-1b39-40d0-8cca-3888dd0b69cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Oct 10 12:22:16.036827 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 671/1277] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:16.901081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:16.901761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:16.913064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:16.913064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:16.913064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:16.913064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:16.913609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:16.913609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:17.046287 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:17.059588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a4e1c7a1-9b0a-46e5-b956-10c42ae4d80e tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1314 microversion: 2.1 time: 0.158429 Oct 10 12:22:17.059588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 672/1278] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:16 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:18.082624 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:18.083277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:18.091049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:18.091522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:18.091953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:18.092630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:18.093082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:18.093498 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:18.232116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:18.240185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ed6e1e56-05bd-4050-a954-57bfdbb0277a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1464 microversion: 2.1 time: 0.161497 Oct 10 12:22:18.241727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 673/1279] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:18 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:18.291484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:18.291987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:18.297893 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:18.298377 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:18.298852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:18.299701 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:18.300033 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:18.300471 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:18.326193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:22:18.645714 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b5f09da2-4595-418b-ac41-033bc49d61a9 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 204 len: 0 microversion: 2.1 time: 0.358561 Oct 10 12:22:18.646469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 674/1280] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:22:18 2022] DELETE /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:22:18.661506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:18.662118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:18.668326 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:18.668800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:18.669239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:18.669941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:18.670397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:18.670864 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:18.811277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:18.819156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-af4aabca-70c7-4a0c-84ad-47e084a8c292 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1470 microversion: 2.1 time: 0.161993 Oct 10 12:22:18.819732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 675/1281] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:18 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:19.845038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:19.847216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:19.862607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:19.862607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:19.862607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:19.862607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:19.863590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:19.863590 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:20.019732 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:20.023594 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:22:20.028778 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-90e2f381-1345-4277-95bb-edbca136d0c6 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1470 microversion: 2.1 time: 0.189812 Oct 10 12:22:20.029891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 676/1282] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:19 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:20.887389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-6335a670-5db1-4c6e-a18e-96b3807e38ce req-724b0942-071d-438e-ab2f-453e5e3e81e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee45b48-6e03-4f6b-bb8e-e63251532a27", "name": "network-vif-deleted", "tag": "26fd7740-60c2-4f85-8fee-7642937d7612"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:22:20.895661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6335a670-5db1-4c6e-a18e-96b3807e38ce req-724b0942-071d-438e-ab2f-453e5e3e81e3 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:20.896144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6335a670-5db1-4c6e-a18e-96b3807e38ce req-724b0942-071d-438e-ab2f-453e5e3e81e3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:20.896576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6335a670-5db1-4c6e-a18e-96b3807e38ce req-724b0942-071d-438e-ab2f-453e5e3e81e3 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:20.912082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-6335a670-5db1-4c6e-a18e-96b3807e38ce req-724b0942-071d-438e-ab2f-453e5e3e81e3 service nova] Creating event network-vif-deleted:26fd7740-60c2-4f85-8fee-7642937d7612 for instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 on hv-cinder-86020 Oct 10 12:22:20.918547 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-6335a670-5db1-4c6e-a18e-96b3807e38ce req-724b0942-071d-438e-ab2f-453e5e3e81e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037304 Oct 10 12:22:20.919716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 677/1283] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:22:21.055199 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:21.055907 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:21.062205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:21.062707 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:21.063154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:21.063864 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:21.064303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:21.064730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:21.130499 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:21.140525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-41ac9bce-ab38-42e7-8d8e-4c561f6bbf7a tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1428 microversion: 2.1 time: 0.089735 Oct 10 12:22:21.145424 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 678/1284] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:21 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:22.165341 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:22.166190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:22.172037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:22.172528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:22.172970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:22.173678 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:22.174131 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:22.174636 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:22.240549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:22.248677 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7ab1486c-36cb-4d54-8002-b290294c668c tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1428 microversion: 2.1 time: 0.088714 Oct 10 12:22:22.249414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 679/1285] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:22 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:23.271515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:23.272171 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:23.279230 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:23.279721 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:23.280162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:23.280868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:23.281324 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:23.281756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:23.346728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:23.354609 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0b909fe7-e372-4215-97c2-f9e463e9c8b1 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1428 microversion: 2.1 time: 0.087103 Oct 10 12:22:23.355439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 680/1286] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:23 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:24.378637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:24.379281 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:24.387068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:24.387556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:24.387998 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:24.388706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:24.389159 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:24.389585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:24.421935 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:24.422558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:24.423023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:24.423475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lazy-loading 'fault' on Instance uuid 2ee45b48-6e03-4f6b-bb8e-e63251532a27 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:22:24.477616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edddd32b0093470482df3491ed69ad6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931d44e7d8c84dad9aa3c64eafd899d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:22:24.485600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d09063b7-0459-4e2a-9db7-99e7f7524d7b tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 200 len: 1304 microversion: 2.1 time: 0.110758 Oct 10 12:22:24.486178 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 681/1287] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:24 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:22:25.510275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:22:25.514389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] [instance: 2ee45b48-6e03-4f6b-bb8e-e63251532a27] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:22:25.518421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:25.518946 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:25.519641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:25.520426 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:22:25.520883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:22:25.521372 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:22:25.544066 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] HTTP exception thrown: Instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 could not be found. Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Request method failure captured: Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 HTTP/1.1 Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA5pSivmXdpA9Syiz5Azd8dBmDoh0saJZkP8JO5EMdbYM1_1RIFnrDKQv3fuiMR_nyzFNpcaMmnqboyRkMDv-uUBF-a_g7bCS_4EcvnrhQz7p4wUg5iEnnVFsDxH3dKCLGUKkiXQMuHK767uT6qI61K5hxqtDH6fYJgPvfOKGAIMAjA Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: 931d44e7d8c84dad9aa3c64eafd899d8 Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-VolumesNegativeTest-167966542 Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:22:25.548514 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/931d44e7d8c84dad9aa3c64eafd899d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_931d44e7d8c84dad9aa3c64eafd899d8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/931d44e7d8c84dad9aa3c64eafd899d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/931d44e7d8c84dad9aa3c64eafd899d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-VolumesNegativeTest-167966542 Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: 931d44e7d8c84dad9aa3c64eafd899d8 Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-VolumesNegativeTest-167966542 Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-VolumesNegativeTest-167966542-project Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: edddd32b0093470482df3491ed69ad6c Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-VolumesNegativeTest-167966542-project Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 could not be found. Oct 10 12:22:25.550263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '2ee45b48-6e03-4f6b-bb8e-e63251532a27'} Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 could not be found. Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:22:25.552296 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 could not be found. Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 could not be found. Oct 10 12:22:25.553974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:22:25.555717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] Returning 404 to user: Instance 2ee45b48-6e03-4f6b-bb8e-e63251532a27 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:22:25.555717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f782c090-07a6-45aa-b92d-da7ddc1a6a93 tempest-VolumesNegativeTest-167966542 tempest-VolumesNegativeTest-167966542-project] 10.222.0.46 "GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27" status: 404 len: 111 microversion: 2.1 time: 0.042027 Oct 10 12:22:25.555717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 682/1288] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:22:25 2022] GET /compute/v2.1/servers/2ee45b48-6e03-4f6b-bb8e-e63251532a27 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:23:20.460657 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:20.461653 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:20.464149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:20.465212 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=30 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:20.472921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:20.476473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:20.476473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:20.476473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:20.476473 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:20.476846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:20.509063 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lazy-loading 'flavor' on Instance uuid 7b8283f5-756d-4f3b-b196-70911e57a279 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:23:20.824469 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-979490f1-46dc-4013-ac5c-d1553f67cf97 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "POST /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279/action" status: 202 len: 0 microversion: 2.1 time: 0.367617 Oct 10 12:23:20.825541 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 683/1289] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:23:20 2022] POST /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:23:20.837654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:20.840330 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:20.846568 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:20.847105 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:20.847585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:20.849077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:20.850311 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:20.850774 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:21.018800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:21.028679 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a84775b1-a551-4eb5-9f9d-238d3747aaba tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.195387 Oct 10 12:23:21.044768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 684/1290] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:20 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:22.053843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:22.054579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:22.061232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:22.062362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:22.062831 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:22.063578 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:22.064150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:22.064584 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:22.198886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:22.213493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-429962d9-c9c0-4df2-8e40-368b4f6972b3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.164166 Oct 10 12:23:22.214395 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 685/1291] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:22 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:23.237842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:23.238600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:23.246891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:23.247496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:23.248009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:23.248789 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:23.249374 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:23.250009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:23.391388 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:23.399872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-cdb7b572-1df4-42d5-aaa5-d28785ec3331 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.166377 Oct 10 12:23:23.414735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 686/1292] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:23 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:24.424720 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:24.426195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:24.433549 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:24.434043 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:24.434487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:24.435220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:24.435677 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:24.436135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:24.592103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:24.601890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2e569579-253a-4e33-b657-867208148978 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.181607 Oct 10 12:23:24.602662 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 687/1293] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:24 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:25.630855 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:25.631999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:25.641040 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:25.641528 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:25.642044 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:25.642730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:25.643188 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:25.647567 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:25.787761 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:25.813865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eb778cef-4d8e-4eb7-a4fb-f1d7d7bef53e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.173962 Oct 10 12:23:25.813865 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 688/1294] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:25 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:26.174608 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0da6dff0-69b3-459c-a5e9-4c6b8ab13e69 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Action: 'create', calling method: .version_select at 0x7f6d129cee50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1939953662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKDv0dlr08VcUAvlSm5Jm+G6ejLQr8URlsLPrXXXK2p8piBzw/De9zaReP2bDcFnQPj8cppS5BxmACJ80rV4XfQP/K9q7FbyQzTjKdBprTyVr1VpVaq2PncbnOnel8NSw=="}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:26.190523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-0da6dff0-69b3-459c-a5e9-4c6b8ab13e69 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Getting quotas for project bafe96e8ab4d498981d0e309c484c125. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:23:26.194551 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-0da6dff0-69b3-459c-a5e9-4c6b8ab13e69 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Getting quotas for user 2db334d548cf45a7a338a7fcc30ac3c4 and project bafe96e8ab4d498981d0e309c484c125. Resources: {'key_pairs'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:23:26.316642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0da6dff0-69b3-459c-a5e9-4c6b8ab13e69 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.145950 Oct 10 12:23:26.317181 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 689/1295] 10.222.0.46 () {60 vars in 1159 bytes} [Mon Oct 10 12:23:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:23:26.369605 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2051553133", "imageRef": "2149487d-3bbd-415e-a0f8-cdfb8b71ba3c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1939953662", "networks": [{"uuid": "8d4a34b1-1f2e-4fc3-91e5-0ad6bb600316"}]}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:26.422375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.network.neutron [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] validate_networks() for [('8d4a34b1-1f2e-4fc3-91e5-0ad6bb600316', None, None, None, None, None)] {{(pid=121297) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 12:23:26.897242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Flavor limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 12:23:26.897836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Image limits 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 12:23:26.898158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Flavor pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 12:23:26.898571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Image pref 0:0:0 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 12:23:26.899015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.virt.hardware [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 12:23:26.908414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:26.908900 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:26.909338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:26.910069 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:26.910525 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:26.910981 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:26.928579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Getting quotas for project bafe96e8ab4d498981d0e309c484c125. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 12:23:26.932658 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.quota [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Getting quotas for user 2db334d548cf45a7a338a7fcc30ac3c4 and project bafe96e8ab4d498981d0e309c484c125. Resources: {'cores', 'instances', 'ram'} {{(pid=121297) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 12:23:26.943840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Going to run 1 instances... {{(pid=121297) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 12:23:26.946068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2149487d-3bbd-415e-a0f8-cdfb8b71ba3c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121297) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 12:23:27.062910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a058a995-0f5d-46e5-8f6b-4373ec0b59bc tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697249 Oct 10 12:23:27.063588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 690/1296] 10.222.0.46 () {60 vars in 1147 bytes} [Mon Oct 10 12:23:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 12:23:27.068172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:27.068785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:27.075147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:27.075630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:27.076068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:27.076804 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:27.077925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:27.079536 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:27.238847 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:27.247087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bf62cb8f-b9fb-4f6e-8cc5-86a50b26fac2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.182429 Oct 10 12:23:27.247756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 691/1297] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:27 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:27.253356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b86ed451-f7a2-4a73-a4f7-1fa98d2b4da7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:27.254111 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b86ed451-f7a2-4a73-a4f7-1fa98d2b4da7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:27.313762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b86ed451-f7a2-4a73-a4f7-1fa98d2b4da7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:27.318444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b86ed451-f7a2-4a73-a4f7-1fa98d2b4da7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1259 microversion: 2.1 time: 0.068900 Oct 10 12:23:27.319050 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 692/1298] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:27 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:28.270335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:28.271052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:28.278182 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:28.278659 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:28.279121 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:28.279806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:28.280280 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:28.280702 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:28.417343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:28.425806 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e0020d35-eead-404a-a393-815921ca065a tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.159431 Oct 10 12:23:28.429001 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 693/1299] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:28 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:28.431010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:28.431616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:28.437742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:28.438218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:28.438656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:28.439369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:28.439828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:28.440243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:28.502610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:28.510254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fa7058f8-c1ca-4a82-bb8d-31d68e9ff987 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1263 microversion: 2.1 time: 0.082831 Oct 10 12:23:28.510837 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 694/1300] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:28 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:29.449174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:29.449995 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:29.457087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:29.457573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:29.458004 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:29.458978 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:29.459436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:29.459861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:29.596903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:29.605339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-df5f43fa-3789-4762-9983-7cac3526bb26 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.160023 Oct 10 12:23:29.606145 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 695/1301] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:29 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:29.614096 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:29.614727 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:29.620911 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:29.627457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:29.627457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:29.627457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:29.627457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:29.627875 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:29.692938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:29.701242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0fbaaa78-089c-4d6e-98c6-d28b6b746333 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1319 microversion: 2.1 time: 0.094143 Oct 10 12:23:29.701810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 696/1302] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:29 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:30.629766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:30.630656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:30.638206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:30.639158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:30.639642 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:30.641057 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:30.641621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:30.642048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:30.939245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:30.947940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-00c0dde8-f64d-4d6b-b4d3-c19ed527b33e tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.322006 Oct 10 12:23:30.948529 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 697/1303] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:30 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:30.954089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:30.954955 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:30.961747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:30.962224 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:30.962656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:30.963420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:30.963869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:30.964288 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:31.101662 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:31.110421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d56e05de-fbca-4583-9364-3da4e9f0448c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.160718 Oct 10 12:23:31.111048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 698/1304] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:30 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:31.976129 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:31.976818 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:31.983274 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:31.984255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:31.984687 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:31.985380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:31.985826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:31.986437 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:32.136983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:32.147401 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-55ae6697-57d2-4b21-bc48-2c2f56afcb3d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.174416 Oct 10 12:23:32.162691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 699/1305] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:31 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:32.162691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:32.162691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:32.168133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:32.168621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:32.169062 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:32.169845 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:32.170307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:32.170779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:32.176216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:32.313137 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:32.323769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-766015c8-d31f-405e-bb29-3579ef52fac2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.166654 Oct 10 12:23:32.324354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 700/1306] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:32 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:33.172842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:33.173523 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:33.180948 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:33.181483 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:33.181872 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:33.182585 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:33.183059 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:33.183489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:33.330132 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:33.341509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d2b57fd1-c931-4d77-a20c-bc425e0db8c9 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.172653 Oct 10 12:23:33.342169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 701/1307] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:33 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:33.364574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:33.365202 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:33.372396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:33.372909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:33.373380 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:33.374095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:33.375160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:33.375599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:33.533153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:33.541939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f7033e74-e449-47f9-b619-c90e4a62d5cb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.181228 Oct 10 12:23:33.553700 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 702/1308] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:33 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:34.366116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:34.366949 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:34.373538 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:34.374075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:34.374630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:34.375436 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:34.376036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:34.376321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:34.522607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:34.531302 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-47452ae5-1083-4474-a4ab-fd3b2b90fe00 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.169084 Oct 10 12:23:34.532660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 703/1309] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:34 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:34.565461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:34.566176 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:34.572786 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:34.573530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:34.573994 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:34.574730 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:34.575185 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:34.575618 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:34.736151 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:34.745477 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-78a83578-55df-48d0-9a92-2ab0c08587ce tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.183781 Oct 10 12:23:34.746360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 704/1310] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:34 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:35.557556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:35.558481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:35.565354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:35.565851 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:35.566295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:35.567039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:35.567503 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:35.567930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:35.723237 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:35.733087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2842c04a-0415-4771-a39f-44ee2445309c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.180475 Oct 10 12:23:35.739830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 705/1311] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:35 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:35.769161 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:35.769779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:35.776187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:35.776664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:35.777734 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:35.778449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:35.778940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:35.779356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:35.930604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:35.939800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-98b54305-eada-4203-a048-82ee93d6e5b4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.174877 Oct 10 12:23:35.947969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 706/1312] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:35 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:36.756521 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:36.757197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:36.764801 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:36.765293 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:36.765780 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:36.767076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:36.767571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:36.768095 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:36.917051 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:36.922962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:36.952782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e559ad09-fe53-4696-8e2e-2150b567096d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.179776 Oct 10 12:23:36.952782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 707/1313] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:36 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:36.966212 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:36.967016 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:36.973790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:36.974355 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:36.974960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:36.975849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:36.976419 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:36.976959 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:37.178623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:37.178623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d3639d39-b740-42e4-8ced-abf00ec73d72 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.200900 Oct 10 12:23:37.178623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 708/1314] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:36 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:37.968507 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:37.969163 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:37.971010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=12 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:37.976308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:37.976795 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:37.977236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:37.977930 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:37.978385 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:37.978854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:38.112977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:38.121035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0be5edf9-79f9-4dcf-854c-042a6af50c8d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.156504 Oct 10 12:23:38.121741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 709/1315] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:37 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:38.200336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:38.200954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:38.207139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:38.207619 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:38.208059 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:38.209006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:38.209462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:38.209889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:38.338833 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:38.347102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5c18ee47-d671-448c-ba07-b46e2bf36638 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.150659 Oct 10 12:23:38.347682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 710/1316] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:38 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:39.144908 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:39.145536 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:39.152130 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:39.152615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:39.153054 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:39.153748 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:39.154205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:39.154630 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:39.288943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:39.296969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d14a3138-4c98-4b44-9526-0189ea540418 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.156624 Oct 10 12:23:39.297552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 711/1317] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:39 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:39.370266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:39.370927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:39.377569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:39.378052 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:39.378490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:39.379223 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:39.379680 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:39.380110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:39.511377 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:39.519235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-31bf7222-df17-4bf8-a370-cb9c19bf8693 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.152834 Oct 10 12:23:39.519810 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 712/1318] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:39 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:40.321082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:40.321693 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:40.328306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:40.328787 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:40.329267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:40.330740 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:40.331229 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:40.331673 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:40.472936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:40.484593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a8bc6a02-e998-4d1e-bbed-e843590a9889 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.167461 Oct 10 12:23:40.485338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 713/1319] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:40 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:40.541933 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:40.542576 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:40.548654 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:40.549135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:40.549573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:40.550266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:40.550741 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:40.551167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:40.681191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:40.689429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5c2a4579-339a-4155-93ce-213e508bdc20 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.150848 Oct 10 12:23:40.690007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 714/1320] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:40 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:41.508311 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:41.508925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:41.515548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:41.516025 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:41.516457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:41.517139 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:41.517626 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:41.518635 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:41.650239 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:41.658126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7bc01957-90a5-4ed6-acd1-2bf68d966d68 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.153712 Oct 10 12:23:41.659295 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 715/1321] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:41 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:41.711844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:41.712450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:41.718354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:41.718848 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:41.719280 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:41.719962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:41.720408 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:41.720823 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:41.852571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:41.856122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=100 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:41.860721 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0c2d5c36-d9e5-4492-8ff7-7e335e6db019 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.152787 Oct 10 12:23:41.861454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 716/1322] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:41 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:42.682370 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:42.683010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:42.689180 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:42.689665 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:42.690106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:42.690844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:42.691303 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:42.691731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:42.856757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:42.867791 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1d01a005-7268-49e2-b814-563bfae07474 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.190024 Oct 10 12:23:42.868657 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 717/1323] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:42 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:42.884515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:42.886265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:42.889947 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:42.895530 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:42.903999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:42.903999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:42.903999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:42.903999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:42.904409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:43.051821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:43.059625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ae494642-12c6-46d7-baab-41386d462fc8 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.179435 Oct 10 12:23:43.060197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 718/1324] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:42 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:43.290744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-dc5c1dfe-51e5-4419-8a32-0cc5daf73f80 req-5939feb2-5620-4b99-ba9e-7f8c97329a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ee1609-eec2-4304-ba1b-49044ccb4649", "tag": "646a539a-b920-4fec-9f0e-2812477d2113"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:43.301220 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-dc5c1dfe-51e5-4419-8a32-0cc5daf73f80 req-5939feb2-5620-4b99-ba9e-7f8c97329a39 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:43.301692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-dc5c1dfe-51e5-4419-8a32-0cc5daf73f80 req-5939feb2-5620-4b99-ba9e-7f8c97329a39 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:43.302122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-dc5c1dfe-51e5-4419-8a32-0cc5daf73f80 req-5939feb2-5620-4b99-ba9e-7f8c97329a39 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:43.313352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-dc5c1dfe-51e5-4419-8a32-0cc5daf73f80 req-5939feb2-5620-4b99-ba9e-7f8c97329a39 service nova] Creating event network-changed:646a539a-b920-4fec-9f0e-2812477d2113 for instance 33ee1609-eec2-4304-ba1b-49044ccb4649 on hv-cinder-86020 Oct 10 12:23:43.319149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-dc5c1dfe-51e5-4419-8a32-0cc5daf73f80 req-5939feb2-5620-4b99-ba9e-7f8c97329a39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032188 Oct 10 12:23:43.319742 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 719/1325] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:23:43.891854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:43.892564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:43.899082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:43.899565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:43.900007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:43.900690 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:43.901144 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:43.901573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:44.030697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:44.038926 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2730af7f-850c-4ef0-80fa-c0f11dcd29ca tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.151814 Oct 10 12:23:44.039495 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 720/1326] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:43 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:44.087689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:44.088307 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:44.094183 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:44.094759 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:44.095162 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:44.095858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:44.096314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:44.096744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:44.233621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:44.241733 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-88d115f1-7e5c-4a9f-81d8-d2b3257354e2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.158017 Oct 10 12:23:44.242322 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 721/1327] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:44 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:45.061317 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:45.063135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:45.069686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:45.070292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:45.070849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:45.071788 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:45.072252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:45.072703 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:45.209661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:45.217731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7b373f15-0403-4e8a-ba40-5990ab6bfdd0 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.160189 Oct 10 12:23:45.218369 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 722/1328] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:45 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:45.265455 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:45.266068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:45.272635 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:45.273138 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:45.273556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:45.274246 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:45.274725 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:45.275155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:45.406943 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:45.415674 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ae61c0e8-378f-4d30-84df-c9dce9d3856e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.154195 Oct 10 12:23:45.420023 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 723/1329] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:45 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:46.242172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:46.242820 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:46.249172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:46.249652 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:46.250089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:46.250805 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:46.251258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:46.251681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:46.386386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:46.394938 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f7102d70-1cd6-42ed-adf8-194b12439629 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.156726 Oct 10 12:23:46.395512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 724/1330] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:46 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:46.439120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:46.439720 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:46.445639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:46.446120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:46.446560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:46.447277 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:46.447734 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:46.448165 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:46.577362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:46.585681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-56dd9f04-24d4-49f8-9883-5f2fdea6dd8a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.150356 Oct 10 12:23:46.586263 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 725/1331] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:46 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:47.418529 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:47.419166 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:47.426456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:47.426969 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:47.427409 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:47.428104 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:47.428554 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:47.428976 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:47.565571 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:47.573552 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-7cd08346-f578-494b-993b-4067f4d4e729 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.158936 Oct 10 12:23:47.574122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 726/1332] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:47 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:47.609354 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:47.609954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:47.616112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:47.617158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:47.617158 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:47.617821 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:47.618323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:47.618778 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:47.748387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:47.756486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-17005faf-4c27-40b9-ba00-bd6217dab367 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.151120 Oct 10 12:23:47.757236 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 727/1333] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:47 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:48.597126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:48.597970 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:48.605015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:48.605502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:48.605936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:48.606625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:48.607100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:48.607522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:48.740987 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:48.748817 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-3721bf50-a119-4e7c-8113-9c1c46f2b3ed tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1510 microversion: 2.1 time: 0.156086 Oct 10 12:23:48.749402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 728/1334] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:48 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:48.753762 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-77f8e026-cd3b-4539-89ae-3f1708da6a1b req-e9f95488-b8de-43de-8d1c-00e74fa96450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8283f5-756d-4f3b-b196-70911e57a279", "name": "network-vif-unplugged", "status": "completed", "tag": "1ab60eb3-8fcd-4845-885c-e9230a320fe7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:48.762785 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-77f8e026-cd3b-4539-89ae-3f1708da6a1b req-e9f95488-b8de-43de-8d1c-00e74fa96450 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:48.763262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-77f8e026-cd3b-4539-89ae-3f1708da6a1b req-e9f95488-b8de-43de-8d1c-00e74fa96450 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:48.763692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-77f8e026-cd3b-4539-89ae-3f1708da6a1b req-e9f95488-b8de-43de-8d1c-00e74fa96450 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:48.777055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.compute.server_external_events [req-77f8e026-cd3b-4539-89ae-3f1708da6a1b req-e9f95488-b8de-43de-8d1c-00e74fa96450 service nova] Unable to find a host for instance 7b8283f5-756d-4f3b-b196-70911e57a279. Dropping event network-vif-unplugged {{(pid=121297) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 12:23:48.781604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-77f8e026-cd3b-4539-89ae-3f1708da6a1b req-e9f95488-b8de-43de-8d1c-00e74fa96450 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027640 Oct 10 12:23:48.781604 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 729/1335] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 12:23:48.783148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:48.784267 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:48.790513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:48.791036 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:48.791634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:48.792205 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:48.792612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:48.793081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:48.836648 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121297) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 12:23:49.145020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b3fdcdf5-6351-4b98-913c-4dfdb870028c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "POST /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279/action" status: 202 len: 0 microversion: 2.1 time: 0.365380 Oct 10 12:23:49.148418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 730/1336] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:23:48 2022] POST /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 12:23:49.153868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:49.155351 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:49.162664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:49.163275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:49.163775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:49.164483 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:49.164936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:49.165364 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:49.302920 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:49.320686 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f06f08c6-de79-4f9e-ad7b-ba493e124b9e tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.173851 Oct 10 12:23:49.328996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 731/1337] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:49 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:49.328996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:49.328996 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:49.336026 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:49.336756 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:49.337191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:49.337989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:49.338542 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:49.339125 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:49.485566 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:49.502827 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-88dc6bbc-dd7d-4a4c-a7da-259fc74afdf3 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1518 microversion: 2.1 time: 0.170736 Oct 10 12:23:49.502827 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 732/1338] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:49 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:50.344133 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:50.344768 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:50.351203 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:50.351687 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:50.352152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:50.352836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:50.353278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:50.353701 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:50.489705 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:50.493250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:50.497881 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bb39bd58-9ccb-4277-9bef-96ce5f678a5c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.157805 Oct 10 12:23:50.498467 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 733/1339] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:50 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:50.523899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:50.524610 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:50.530560 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:50.531082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:50.531497 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:50.532174 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:50.532617 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:50.533034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:50.670961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:50.679305 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-11e6de4c-ba2d-4b31-8341-1a818e43ae49 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1520 microversion: 2.1 time: 0.159317 Oct 10 12:23:50.679897 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 734/1340] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:50 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:50.803490 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-778ac508-42ca-493a-a312-bf0d251c62e8 req-4edc47d4-dd95-4e28-8022-ac01c9164e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ee1609-eec2-4304-ba1b-49044ccb4649", "name": "network-vif-plugged", "status": "completed", "tag": "646a539a-b920-4fec-9f0e-2812477d2113"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:50.813927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-778ac508-42ca-493a-a312-bf0d251c62e8 req-4edc47d4-dd95-4e28-8022-ac01c9164e49 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:50.814443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-778ac508-42ca-493a-a312-bf0d251c62e8 req-4edc47d4-dd95-4e28-8022-ac01c9164e49 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:50.814890 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-778ac508-42ca-493a-a312-bf0d251c62e8 req-4edc47d4-dd95-4e28-8022-ac01c9164e49 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:50.826149 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-778ac508-42ca-493a-a312-bf0d251c62e8 req-4edc47d4-dd95-4e28-8022-ac01c9164e49 service nova] Creating event network-vif-plugged:646a539a-b920-4fec-9f0e-2812477d2113 for instance 33ee1609-eec2-4304-ba1b-49044ccb4649 on hv-cinder-86020 Oct 10 12:23:50.832233 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-778ac508-42ca-493a-a312-bf0d251c62e8 req-4edc47d4-dd95-4e28-8022-ac01c9164e49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032986 Oct 10 12:23:50.833110 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 735/1341] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:23:51.522896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:51.523612 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:51.530577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:51.531120 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:51.531561 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:51.532264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:51.532726 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:51.533266 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:51.671964 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:51.680306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ea83a75f-ab48-4c6d-b0e8-92d270ebe5f0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.161732 Oct 10 12:23:51.680894 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 736/1342] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:51 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:51.702602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:51.703242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:51.710061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:51.710548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:51.711017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:51.711708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:51.712160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:51.712607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:51.852882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:51.861048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5e2f22d7-1ff7-4340-9276-a3e101191a2b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1520 microversion: 2.1 time: 0.162056 Oct 10 12:23:51.861664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 737/1343] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:51 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:52.704411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:52.705606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:52.711888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:52.712373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:52.712816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:52.713506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:52.713961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:52.714389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:52.848084 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:52.856122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ee63b54a-a86d-49a2-ba5f-526b7d391f98 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1359 microversion: 2.1 time: 0.156098 Oct 10 12:23:52.856706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 738/1344] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:52 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:52.884850 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:52.885142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:52.891367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:52.895491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:52.895491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:52.895491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:52.895491 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:52.895915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:53.041349 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:53.049429 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-161471a0-67da-4042-8b2c-5d287b74a41f tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.168970 Oct 10 12:23:53.049936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 739/1345] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:52 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:53.879861 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:53.880537 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:53.886735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:53.893318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:53.893318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:53.893318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:53.893318 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:53.893757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.016562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:54.028075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-335301f3-f79c-492b-a2d8-a9896d392e82 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1549 microversion: 2.1 time: 0.152751 Oct 10 12:23:54.028663 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 740/1346] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:53 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:54.050421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:54.051070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:54.057100 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.057586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.058024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.058739 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.059196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.059623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.196857 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:54.205060 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5310b8a2-f240-4243-aa80-5da3884b7871 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1549 microversion: 2.1 time: 0.158381 Oct 10 12:23:54.205545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 741/1347] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:54 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:54.210339 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:54.213718 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:54.217031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.217544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.217986 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.219041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.219498 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.219927 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.354298 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:54.362441 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4cee455a-67db-49cc-896c-9f2180f227b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.155924 Oct 10 12:23:54.363059 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 742/1348] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:54 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:54.367537 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:54.372346 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:54.373103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Searching by: {'deleted': False, 'project_id': 'bafe96e8ab4d498981d0e309c484c125'} {{(pid=121297) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 12:23:54.379593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.380061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.380485 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.381195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.381635 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.382049 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.474544 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.multi_cell_list [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121297) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 12:23:54.573887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5678e430-2a0f-4bb8-ad78-6366cc6ed679 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209714 Oct 10 12:23:54.574475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 743/1349] 10.222.0.46 () {58 vars in 1125 bytes} [Mon Oct 10 12:23:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:23:54.587005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:54.587614 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:54.593769 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.594250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.594706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.595400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:54.595871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:54.596291 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:54.727240 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:54.735191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-56622621-3788-42f3-ac79-919e66e93f7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1549 microversion: 2.1 time: 0.152223 Oct 10 12:23:54.735772 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 744/1350] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:54 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:55.385489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:55.386146 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:55.392625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:55.393115 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:55.395871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:55.395871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:55.395871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:55.395871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:55.539794 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:55.547804 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-697c397e-1c6a-4de6-afe2-3ad7b00a7c9d tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.166396 Oct 10 12:23:55.551676 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 745/1351] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:55 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:56.572434 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:56.573117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:56.582112 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:56.589874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:56.589874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:56.589874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:56.589874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:56.590346 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:56.717624 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:56.725672 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-eebed43e-20d7-43cd-ac78-88580b2c1b0b tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.157066 Oct 10 12:23:56.726252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 746/1352] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:56 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:23:56.732021 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8e6871a-698c-42cc-9fbb-4b7e38742fdf"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:23:56.734357 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:56.740833 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:56.741327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:56.741764 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:56.742460 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:56.742983 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:56.743408 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:57.484338 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8cba1100-c826-4fa7-8cc7-de179e63e526 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755836 Oct 10 12:23:57.484989 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 747/1353] 10.222.0.46 () {60 vars in 1323 bytes} [Mon Oct 10 12:23:56 2022] POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:23:57.749664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:57.750406 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:57.761421 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:57.761915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:57.762352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:57.763154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:57.763611 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:57.764031 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:57.905454 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:57.913125 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-01ced683-607b-4003-8274-441376e3b409 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.167707 Oct 10 12:23:57.913699 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 748/1354] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:57 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:23:58.936336 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:23:58.936974 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:23:58.943411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:58.943954 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:58.944393 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:58.945109 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:23:58.945559 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:23:58.945981 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:23:59.121901 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:59.236815 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:23:59.244688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ef086cf1-aeda-42df-bacb-97e8a6e0f55c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.312197 Oct 10 12:23:59.245251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 749/1355] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:23:58 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:00.267482 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:00.268156 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:00.274977 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:00.275462 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:00.275898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:00.276583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:00.277028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:00.277449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:00.410055 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:00.418335 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1d42dcf5-ce6f-4170-9f31-78175ee28e33 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.154637 Oct 10 12:24:00.418936 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 750/1356] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:00 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:01.443616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:01.444265 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:01.450787 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:01.451283 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:01.451724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:01.452438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:01.452891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:01.453323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:01.590378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:01.598378 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-51ef2810-64e2-4f9f-9e8a-c7b3d6fdca94 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.159415 Oct 10 12:24:01.599024 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 751/1357] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:01 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:02.621782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:02.622457 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:02.630982 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:02.631773 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:02.632217 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:02.632991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:02.633616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:02.634041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:02.778623 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:02.787153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e3530c89-4b71-41cc-8ebe-57dc2a283720 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.169469 Oct 10 12:24:02.788034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 752/1358] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:02 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:03.810472 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:03.811197 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:03.817573 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:03.818074 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:03.818506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:03.819215 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:03.819661 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:03.820077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:03.954404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:03.962924 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bb795989-30d6-48c8-811d-471d6e597471 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.156312 Oct 10 12:24:03.963481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 753/1359] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:03 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:04.747595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell0:SELECT=2 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:24:04.810757 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-785f8b1c-c533-44c6-957f-a62971076c06 req-22688a18-dfe4-421b-91b8-7f5e9bd94a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8283f5-756d-4f3b-b196-70911e57a279", "name": "network-vif-plugged", "status": "completed", "tag": "1ab60eb3-8fcd-4845-885c-e9230a320fe7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:24:04.820929 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-785f8b1c-c533-44c6-957f-a62971076c06 req-22688a18-dfe4-421b-91b8-7f5e9bd94a52 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:04.821706 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-785f8b1c-c533-44c6-957f-a62971076c06 req-22688a18-dfe4-421b-91b8-7f5e9bd94a52 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:04.822147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-785f8b1c-c533-44c6-957f-a62971076c06 req-22688a18-dfe4-421b-91b8-7f5e9bd94a52 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:04.836381 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-785f8b1c-c533-44c6-957f-a62971076c06 req-22688a18-dfe4-421b-91b8-7f5e9bd94a52 service nova] Creating event network-vif-plugged:1ab60eb3-8fcd-4845-885c-e9230a320fe7 for instance 7b8283f5-756d-4f3b-b196-70911e57a279 on hv-cinder-86020 Oct 10 12:24:04.843891 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-785f8b1c-c533-44c6-957f-a62971076c06 req-22688a18-dfe4-421b-91b8-7f5e9bd94a52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100375 Oct 10 12:24:04.844960 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 754/1360] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:24:04.987535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:04.988254 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:04.994914 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:04.996400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:04.996400 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:04.997289 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:04.997880 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:04.998391 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:05.146991 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:05.155340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b871a5d8-f8eb-43df-bacb-7b5709923730 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.172364 Oct 10 12:24:05.155985 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 755/1361] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:04 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:06.156359 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:06.157090 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:06.164290 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:06.164766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:06.165196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:06.165886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:06.166328 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:06.166779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:06.296886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:06.305255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c6afa5e7-fd84-403c-a352-73ee5378e26c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1595 microversion: 2.1 time: 0.152686 Oct 10 12:24:06.305834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 756/1362] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:06 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:06.327844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:06.327844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:06.327844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:06.327844 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:06.328402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:06.328402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:06.328402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:06.328402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:06.486792 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:06.497889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-d7892dfb-9e48-4565-9aed-43995adb0e3c tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1576 microversion: 2.1 time: 0.187844 Oct 10 12:24:06.497889 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 757/1363] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:06 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:24:07.520154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:07.521717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:07.531476 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:07.532721 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:07.533179 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:07.533899 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:07.534360 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:07.534824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:07.681870 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:07.690276 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-41829dce-b7e2-469d-a04a-f91f5a20e546 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1563 microversion: 2.1 time: 0.175844 Oct 10 12:24:07.690883 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 758/1364] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:07 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:24:08.346771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-ac5e8a77-2ccc-4278-9535-85657447edde req-4fbc3ccf-7c9d-4110-800a-dd17c3017834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ee1609-eec2-4304-ba1b-49044ccb4649", "tag": "646a539a-b920-4fec-9f0e-2812477d2113"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:24:08.357034 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-ac5e8a77-2ccc-4278-9535-85657447edde req-4fbc3ccf-7c9d-4110-800a-dd17c3017834 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:08.357783 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-ac5e8a77-2ccc-4278-9535-85657447edde req-4fbc3ccf-7c9d-4110-800a-dd17c3017834 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:08.358135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-ac5e8a77-2ccc-4278-9535-85657447edde req-4fbc3ccf-7c9d-4110-800a-dd17c3017834 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:08.371285 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-ac5e8a77-2ccc-4278-9535-85657447edde req-4fbc3ccf-7c9d-4110-800a-dd17c3017834 service nova] Creating event network-changed:646a539a-b920-4fec-9f0e-2812477d2113 for instance 33ee1609-eec2-4304-ba1b-49044ccb4649 on hv-cinder-86020 Oct 10 12:24:08.376735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-ac5e8a77-2ccc-4278-9535-85657447edde req-4fbc3ccf-7c9d-4110-800a-dd17c3017834 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 Oct 10 12:24:08.378465 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 759/1365] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:24:11.376962 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-486577707"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:24:11.377588 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:11.384397 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:11.386807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:11.386807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:11.386807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:11.386807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:11.387173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:11.514376 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.network.security_group_api [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Adding security group 4bed0bca-3991-4ac4-89c8-ef56d650286f to port 646a539a-b920-4fec-9f0e-2812477d2113 Oct 10 12:24:11.945124 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-ad7ec836-8baf-4d19-a0b3-846d20ab2226 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/action" status: 202 len: 0 microversion: 2.1 time: 0.573039 Oct 10 12:24:11.945824 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 760/1366] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:24:11 2022] POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:24:12.011255 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-596f8bdd-9b14-4cab-b2cf-a5a9c75e064a req-3da0e03d-3807-4b51-ad50-2c0c2e4099c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ee1609-eec2-4304-ba1b-49044ccb4649", "tag": "646a539a-b920-4fec-9f0e-2812477d2113"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:24:12.021001 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-596f8bdd-9b14-4cab-b2cf-a5a9c75e064a req-3da0e03d-3807-4b51-ad50-2c0c2e4099c7 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:12.021379 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-596f8bdd-9b14-4cab-b2cf-a5a9c75e064a req-3da0e03d-3807-4b51-ad50-2c0c2e4099c7 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:12.021809 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-596f8bdd-9b14-4cab-b2cf-a5a9c75e064a req-3da0e03d-3807-4b51-ad50-2c0c2e4099c7 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:12.033999 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-596f8bdd-9b14-4cab-b2cf-a5a9c75e064a req-3da0e03d-3807-4b51-ad50-2c0c2e4099c7 service nova] Creating event network-changed:646a539a-b920-4fec-9f0e-2812477d2113 for instance 33ee1609-eec2-4304-ba1b-49044ccb4649 on hv-cinder-86020 Oct 10 12:24:12.039600 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-596f8bdd-9b14-4cab-b2cf-a5a9c75e064a req-3da0e03d-3807-4b51-ad50-2c0c2e4099c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090209 Oct 10 12:24:12.040382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 761/1367] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:24:12.047662 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:24:12.048461 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:24:12.055169 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:12.055450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:12.055896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:12.056592 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:24:12.057041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:24:12.057463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:24:12.227173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:24:12.236172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2d30e3f0-6771-43c5-ab40-c8b4d8417c94 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1759 microversion: 2.1 time: 0.193365 Oct 10 12:24:12.236956 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 762/1368] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:24:12 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:25:03.712852 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:25:03.713509 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:25:03.724991 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:25:03.725220 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:25:09.705577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:25:09.708645 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:09.711102 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:25:09.711775 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=66 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:25:09.717463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:09.722173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:09.722173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:09.722173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:09.722173 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:09.723244 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:09.917371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-80620f30-9044-41e8-ac11-08458c305a71 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/action" status: 202 len: 0 microversion: 2.1 time: 0.215642 Oct 10 12:25:09.918017 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 763/1369] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:25:09 2022] POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:25:09.927042 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:09.927749 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:09.934386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:09.934921 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:09.935387 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:09.936117 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:09.936579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:09.937007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:10.087840 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:10.096306 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0051e2fb-851b-4d07-9da1-6313a815e9f9 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1751 microversion: 2.1 time: 0.173938 Oct 10 12:25:10.096892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 764/1370] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:09 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:10.977363 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:25:10.978029 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:25:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:25:11.120928 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:11.121564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:11.128213 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:11.128697 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:11.129143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:11.129836 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:11.130294 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:11.130752 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:11.273532 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:11.281846 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-499c1d1a-5d55-4a5d-9d96-7137cb6fdef7 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.164945 Oct 10 12:25:11.282412 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 765/1371] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:11 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:12.307411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:12.308116 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:12.314375 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:12.314912 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:12.315352 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:12.316041 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:12.316494 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:12.317593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:12.460871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:12.469259 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-dc416c75-211a-4f11-9dd7-367760412fb4 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.165672 Oct 10 12:25:12.469923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 766/1372] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:12 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:13.492868 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:13.493513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:13.500080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:13.500597 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:13.501038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:13.501745 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:13.502201 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:13.502689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:13.646097 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:13.654308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-97513eb2-ceca-4baf-9fb4-281336353f9c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.165401 Oct 10 12:25:13.654910 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 767/1373] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:13 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:14.676797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:14.677464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:14.683923 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:14.684404 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:14.684842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:14.685535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:14.685990 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:14.686451 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:14.829932 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:14.839209 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-808018e5-5025-4e5a-8827-9c570be2fbad tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.166508 Oct 10 12:25:14.839784 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 768/1374] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:14 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:15.861569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:15.862245 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:15.868586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:15.869070 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:15.869512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:15.870207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:15.870691 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:15.871125 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:16.011595 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:16.019862 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6ad882c7-0396-4957-bf42-bdb60e5dad29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.162305 Oct 10 12:25:16.020443 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 769/1375] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:15 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:17.043852 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:17.044481 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:17.050796 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:17.051284 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:17.051724 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:17.052415 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:17.052871 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:17.053444 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:17.196736 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:17.205077 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-18b88da4-6990-4916-8ae0-5bbea19cbf5d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.165375 Oct 10 12:25:17.205711 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 770/1376] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:17 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:18.230081 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:18.230807 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:18.237064 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:18.237535 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:18.237963 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:18.238641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:18.239107 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:18.239522 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:18.381190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:18.389506 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-0c441233-effa-41c3-b2d3-6a7f47a550cf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.163291 Oct 10 12:25:18.390079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 771/1377] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:18 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:19.413075 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:19.413797 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:19.420078 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:19.420553 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:19.420980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:19.421660 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:19.422103 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:19.422519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:19.563589 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:19.571909 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-26cf179e-c3bb-461c-a640-5d2ac38bbffb tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.162656 Oct 10 12:25:19.572487 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 772/1378] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:19 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:20.595639 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:20.596294 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:20.602961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:20.603445 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:20.603884 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:20.604579 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:20.605048 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:20.605484 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:20.754148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:20.763422 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-8139554b-2174-4312-87ca-6a68b2b10efd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.171754 Oct 10 12:25:20.764003 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 773/1379] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:20 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:21.787135 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:21.787845 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:21.795464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:21.795953 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:21.796392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:21.797092 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:21.797548 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:21.797980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:21.942147 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:21.951383 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f1631af6-f83e-4063-bf87-b100ffaa3152 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.168300 Oct 10 12:25:21.951973 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 774/1380] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:21 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:22.975545 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:22.976252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:22.983243 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:22.983738 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:22.984177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:22.984874 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:22.985327 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:22.985754 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:23.128219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:23.136583 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-6d60ef38-e610-4814-a445-7ae882496a74 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.164968 Oct 10 12:25:23.137153 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 775/1381] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:22 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:24.160475 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:24.161157 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:24.167688 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:24.168177 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:24.168616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:24.169316 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:24.169811 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:24.170386 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:24.312299 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:24.320776 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-db0ef6a4-a995-479a-add8-a03ccd7a0e97 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.164405 Oct 10 12:25:24.321367 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 776/1382] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:24 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:25.344858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:25.344858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:25.351196 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:25.351684 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:25.352150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:25.352842 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:25.353301 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:25.353731 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:25.502191 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:25.510925 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2c826176-f11e-4a3e-abb0-5d44b9720a15 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.170777 Oct 10 12:25:25.511509 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 777/1383] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:25 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:26.534803 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:26.535418 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:26.542407 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:26.542915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:26.543353 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:26.544037 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:26.544489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:26.544915 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:26.563450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:25:26.689402 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:26.697689 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fe67fea4-8f31-47f4-a6bd-4bd4461e6d4b tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1756 microversion: 2.1 time: 0.166785 Oct 10 12:25:26.698270 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 778/1384] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:26 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:27.723262 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:27.723967 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:27.730902 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:27.731389 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:27.731833 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:27.732526 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:27.733035 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:27.733414 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:27.878216 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:27.886621 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-5ff72ff8-ad7d-4be5-bedf-722278f10c7a tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1759 microversion: 2.1 time: 0.167245 Oct 10 12:25:27.887210 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 779/1385] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:27 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:44.947356 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:44.950602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:44.950771 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=34 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:25:44.951362 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=8 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:25:44.956449 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:44.956940 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:44.957382 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:44.958094 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:44.958555 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:44.959010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:44.984735 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:25:45.335187 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-2d7be916-3cad-4a3a-906f-03011844c5a1 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 204 len: 0 microversion: 2.1 time: 0.391657 Oct 10 12:25:45.335737 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 780/1386] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:25:44 2022] DELETE /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 12:25:45.341251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-82950b21-aadb-4d21-8af3-332b33fb50ef req-6f390047-d9cc-4dd1-baae-ed65f210a336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8283f5-756d-4f3b-b196-70911e57a279", "tag": "1ab60eb3-8fcd-4845-885c-e9230a320fe7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:25:45.350641 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-82950b21-aadb-4d21-8af3-332b33fb50ef req-6f390047-d9cc-4dd1-baae-ed65f210a336 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:45.351164 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-82950b21-aadb-4d21-8af3-332b33fb50ef req-6f390047-d9cc-4dd1-baae-ed65f210a336 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:45.351602 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-82950b21-aadb-4d21-8af3-332b33fb50ef req-6f390047-d9cc-4dd1-baae-ed65f210a336 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:45.363010 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-82950b21-aadb-4d21-8af3-332b33fb50ef req-6f390047-d9cc-4dd1-baae-ed65f210a336 service nova] Creating event network-changed:1ab60eb3-8fcd-4845-885c-e9230a320fe7 for instance 7b8283f5-756d-4f3b-b196-70911e57a279 on hv-cinder-86020 Oct 10 12:25:45.368438 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-82950b21-aadb-4d21-8af3-332b33fb50ef req-6f390047-d9cc-4dd1-baae-ed65f210a336 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031206 Oct 10 12:25:45.369504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 781/1387] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:25:45.375148 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:45.376744 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:45.382047 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:45.382529 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:45.383028 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:45.383779 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:45.384586 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:45.384716 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:45.527519 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:45.535564 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-bde602a9-08cd-4ecc-8915-e19884ad4101 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.164932 Oct 10 12:25:45.536150 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 782/1388] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:45 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:25:46.559257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:46.560501 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:46.567235 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:46.567758 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:46.568231 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:46.568939 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:46.569392 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:46.569818 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:46.701942 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:46.710398 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b99e4851-51de-4c01-9fa8-494b21f0c3b2 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1569 microversion: 2.1 time: 0.155229 Oct 10 12:25:46.711008 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 783/1389] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:46 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:47.733562 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:47.734240 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:47.740708 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:47.741193 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:47.741634 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:47.742340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:47.742822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:47.743251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:47.879713 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:47.888015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f8dcc55e-f38e-4d5c-9b17-3b9e0cd72cdc tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1450 microversion: 2.1 time: 0.158283 Oct 10 12:25:47.899625 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 784/1390] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:47 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:48.038616 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-6fec895c-e5df-483d-b451-ad4c6c542e15 req-68b4ac9f-3e09-4349-b69c-d6ac1c767a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8283f5-756d-4f3b-b196-70911e57a279", "name": "network-vif-deleted", "tag": "1ab60eb3-8fcd-4845-885c-e9230a320fe7"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:25:48.049160 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6fec895c-e5df-483d-b451-ad4c6c542e15 req-68b4ac9f-3e09-4349-b69c-d6ac1c767a14 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:48.049640 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6fec895c-e5df-483d-b451-ad4c6c542e15 req-68b4ac9f-3e09-4349-b69c-d6ac1c767a14 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:48.050076 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-6fec895c-e5df-483d-b451-ad4c6c542e15 req-68b4ac9f-3e09-4349-b69c-d6ac1c767a14 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:48.063089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-6fec895c-e5df-483d-b451-ad4c6c542e15 req-68b4ac9f-3e09-4349-b69c-d6ac1c767a14 service nova] Creating event network-vif-deleted:1ab60eb3-8fcd-4845-885c-e9230a320fe7 for instance 7b8283f5-756d-4f3b-b196-70911e57a279 on hv-cinder-86020 Oct 10 12:25:48.068238 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-6fec895c-e5df-483d-b451-ad4c6c542e15 req-68b4ac9f-3e09-4349-b69c-d6ac1c767a14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118170 Oct 10 12:25:48.068958 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 785/1391] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:25:48.911599 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:48.912340 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:48.919067 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:48.919587 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:48.920155 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:48.920849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:48.921292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:48.921712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:48.985275 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c796e1544354dbe9d1139c77b05f477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ab1776de294ca1a23fc110b2f9af1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:25:48.993029 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f28d8157-c47b-4535-933d-39b81d6557d8 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 200 len: 1219 microversion: 2.1 time: 0.086332 Oct 10 12:25:48.993589 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 786/1392] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:48 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:25:50.017637 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:50.018320 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] [instance: 7b8283f5-756d-4f3b-b196-70911e57a279] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:25:50.024887 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:50.025371 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:50.025828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:50.026511 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:25:50.026992 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:25:50.027420 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:25:50.041577 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] HTTP exception thrown: Instance 7b8283f5-756d-4f3b-b196-70911e57a279 could not be found. Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Request method failure captured: Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 HTTP/1.1 Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA3NtCgxFz59lcvIlnsVVbHJd0oBryC9YDaz2xilMWo9hpGdIBXi9rbx9rpVf8LYCijxBT4OHUea1oQkR4eSfaNNH7a1HMmOQHNgCVJL530XA9iKCv0sn3BQt_Q360KFjeyevFMTsBieNlU4Soj3llAz5J-8TvCRkr6Gk8Ebqdk_vd8 Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: c6ab1776de294ca1a23fc110b2f9af1d Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-TestShelveInstance-530097322 Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:25:50.043321 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c6ab1776de294ca1a23fc110b2f9af1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c6ab1776de294ca1a23fc110b2f9af1d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c6ab1776de294ca1a23fc110b2f9af1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c6ab1776de294ca1a23fc110b2f9af1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-TestShelveInstance-530097322 Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: c6ab1776de294ca1a23fc110b2f9af1d Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-TestShelveInstance-530097322 Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-TestShelveInstance-530097322-project Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 8c796e1544354dbe9d1139c77b05f477 Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-TestShelveInstance-530097322-project Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 7b8283f5-756d-4f3b-b196-70911e57a279 could not be found. Oct 10 12:25:50.045828 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '7b8283f5-756d-4f3b-b196-70911e57a279'} Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8283f5-756d-4f3b-b196-70911e57a279 could not be found. Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:25:50.046826 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8283f5-756d-4f3b-b196-70911e57a279 could not be found. Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8283f5-756d-4f3b-b196-70911e57a279 could not be found. Oct 10 12:25:50.048456 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:25:50.050118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Returning 404 to user: Instance 7b8283f5-756d-4f3b-b196-70911e57a279 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:25:50.050118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-c1aabe3c-82ee-448e-b2be-31e3e79f05c7 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279" status: 404 len: 111 microversion: 2.1 time: 0.031724 Oct 10 12:25:50.050118 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 787/1393] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:25:50 2022] GET /compute/v2.1/servers/7b8283f5-756d-4f3b-b196-70911e57a279 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:25:50.310493 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-4ed4266a-493d-4d8f-9fba-1203c8fff483 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] Calling method '.version_select at 0x7f6d160bd550>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:25:50.414292 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-4ed4266a-493d-4d8f-9fba-1203c8fff483 tempest-TestShelveInstance-530097322 tempest-TestShelveInstance-530097322-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1906261316" status: 202 len: 0 microversion: 2.1 time: 0.107645 Oct 10 12:25:50.414941 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 788/1394] 10.222.0.46 () {58 vars in 1254 bytes} [Mon Oct 10 12:25:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1906261316 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:26:23.485834 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:23.486593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG dbcounter [-] [121297] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121297) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:23.491251 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-486577707"}} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:26:23.491790 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:23.498486 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:23.499022 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:23.499474 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:23.500167 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:23.500656 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:23.501088 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:23.629431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.network.security_group_api [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Removing security group 4bed0bca-3991-4ac4-89c8-ef56d650286f from port 646a539a-b920-4fec-9f0e-2812477d2113 Oct 10 12:26:24.016172 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-9f10a196-a972-416e-828d-cb37552ff2e0 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/action" status: 202 len: 0 microversion: 2.1 time: 0.531950 Oct 10 12:26:24.020569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 789/1395] 10.222.0.46 () {60 vars in 1278 bytes} [Mon Oct 10 12:26:23 2022] POST /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:26:24.027264 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-f1668b3c-f286-4c64-8ba7-6345d228ed25 req-a4535981-904b-4c6e-8d9f-cfc8791cb804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ee1609-eec2-4304-ba1b-49044ccb4649", "tag": "646a539a-b920-4fec-9f0e-2812477d2113"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:26:24.037512 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f1668b3c-f286-4c64-8ba7-6345d228ed25 req-a4535981-904b-4c6e-8d9f-cfc8791cb804 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:24.038072 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f1668b3c-f286-4c64-8ba7-6345d228ed25 req-a4535981-904b-4c6e-8d9f-cfc8791cb804 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:24.038513 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-f1668b3c-f286-4c64-8ba7-6345d228ed25 req-a4535981-904b-4c6e-8d9f-cfc8791cb804 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:24.050822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-f1668b3c-f286-4c64-8ba7-6345d228ed25 req-a4535981-904b-4c6e-8d9f-cfc8791cb804 service nova] Creating event network-changed:646a539a-b920-4fec-9f0e-2812477d2113 for instance 33ee1609-eec2-4304-ba1b-49044ccb4649 on hv-cinder-86020 Oct 10 12:26:24.056268 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-f1668b3c-f286-4c64-8ba7-6345d228ed25 req-a4535981-904b-4c6e-8d9f-cfc8791cb804 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033047 Oct 10 12:26:24.057278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 790/1396] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:26:25.516206 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:25.517232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:25.524256 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:25.526038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:25.526038 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:25.526961 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:25.527681 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:25.528849 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:25.614015 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lazy-loading 'services' on Instance uuid 33ee1609-eec2-4304-ba1b-49044ccb4649 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:26:25.796207 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e8bcbc99-0562-4987-80d0-e514afeb5291 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments/b8e6871a-698c-42cc-9fbb-4b7e38742fdf" status: 202 len: 0 microversion: 2.1 time: 0.284510 Oct 10 12:26:25.797082 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 791/1397] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:26:25 2022] DELETE /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments/b8e6871a-698c-42cc-9fbb-4b7e38742fdf => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:26:25.806442 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:25.808435 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:25.815027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:25.815593 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:25.816039 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:25.817237 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:25.817694 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:25.818126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:25.849431 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b89e484c-42da-4881-af41-0a5375b28a29 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Oct 10 12:26:25.850009 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 792/1398] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:26:25 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:26:26.076898 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-7ecb1d73-41f2-41d9-a7d6-ade9569ca699 req-9ddbaf50-693a-4ad8-8bba-9350ebaafe70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ee1609-eec2-4304-ba1b-49044ccb4649", "tag": "646a539a-b920-4fec-9f0e-2812477d2113"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:26:26.086558 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7ecb1d73-41f2-41d9-a7d6-ade9569ca699 req-9ddbaf50-693a-4ad8-8bba-9350ebaafe70 service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:26.087079 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7ecb1d73-41f2-41d9-a7d6-ade9569ca699 req-9ddbaf50-693a-4ad8-8bba-9350ebaafe70 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:26.087515 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-7ecb1d73-41f2-41d9-a7d6-ade9569ca699 req-9ddbaf50-693a-4ad8-8bba-9350ebaafe70 service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:26.098533 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-7ecb1d73-41f2-41d9-a7d6-ade9569ca699 req-9ddbaf50-693a-4ad8-8bba-9350ebaafe70 service nova] Creating event network-changed:646a539a-b920-4fec-9f0e-2812477d2113 for instance 33ee1609-eec2-4304-ba1b-49044ccb4649 on hv-cinder-86020 Oct 10 12:26:26.103712 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-7ecb1d73-41f2-41d9-a7d6-ade9569ca699 req-9ddbaf50-693a-4ad8-8bba-9350ebaafe70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030488 Oct 10 12:26:26.104314 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 793/1399] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 12:26:26.862106 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:26.864504 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:26.871488 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:26.872068 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:26.872508 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:26.873208 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:26.873664 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:26.874087 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:26.905122 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-1e8767e3-0c3d-4963-bdbb-f2721f9e37f3 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047447 Oct 10 12:26:26.905892 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 794/1400] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:26:26 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:26:27.920489 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:27.922752 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:27.930008 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:27.930498 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:27.930968 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:27.931682 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:27.932142 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:27.932574 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:27.963250 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-e707947c-7b21-48db-82eb-b5d9c4b8caff tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046823 Oct 10 12:26:27.963896 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 795/1401] 10.222.0.46 () {58 vars in 1302 bytes} [Mon Oct 10 12:26:27 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 12:26:27.975342 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:27.975858 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:27.981882 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:27.982365 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:27.982845 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:27.983556 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:27.984006 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:27.984433 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:28.060869 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] HTTP exception thrown: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 is not attached to volume b8e6871a-698c-42cc-9fbb-4b7e38742fdf Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Request method failure captured: Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: DELETE /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments/b8e6871a-698c-42cc-9fbb-4b7e38742fdf HTTP/1.1 Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA6sfymgAEAsKTwH-YqfKB6f1ngweBapv8y-fJbY1NdUBm6kLAwVr5qD96GQgTGvdY4Qjlcxpxr4VIRN0BZno1KosnnzH1dswwOtuzakkYr0_feHiFjblByK3-PxJIClE2xJSGeOcOGTI-HHq1esRnp3E-jd9CJsxEs3O6WjULzTBLg Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: bafe96e8ab4d498981d0e309c484c125 Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-TestMinimumBasicScenario-72401545 Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:26:28.063450 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bafe96e8ab4d498981d0e309c484c125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bafe96e8ab4d498981d0e309c484c125", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bafe96e8ab4d498981d0e309c484c125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bafe96e8ab4d498981d0e309c484c125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-TestMinimumBasicScenario-72401545 Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: bafe96e8ab4d498981d0e309c484c125 Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-TestMinimumBasicScenario-72401545 Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-TestMinimumBasicScenario-72401545-project Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 2db334d548cf45a7a338a7fcc30ac3c4 Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-TestMinimumBasicScenario-72401545-project Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:26:28.065257 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 is not attached to volume b8e6871a-698c-42cc-9fbb-4b7e38742fdf Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'server_id': '33ee1609-eec2-4304-ba1b-49044ccb4649', 'id': 'b8e6871a-698c-42cc-9fbb-4b7e38742fdf'} Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b8e6871a-698c-42cc-9fbb-4b7e38742fdf. Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:26:28.066232 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 is not attached to volume b8e6871a-698c-42cc-9fbb-4b7e38742fdf Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 is not attached to volume b8e6871a-698c-42cc-9fbb-4b7e38742fdf Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:28.067903 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Returning 404 to user: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 is not attached to volume b8e6871a-698c-42cc-9fbb-4b7e38742fdf {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:26:28.069190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-f5fd7c97-d5d3-43e5-90b0-9ed0a127a10d tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments/b8e6871a-698c-42cc-9fbb-4b7e38742fdf" status: 404 len: 154 microversion: 2.1 time: 0.094243 Oct 10 12:26:28.069190 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 796/1402] 10.222.0.46 () {58 vars in 1416 bytes} [Mon Oct 10 12:26:27 2022] DELETE /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649/os-volume_attachments/b8e6871a-698c-42cc-9fbb-4b7e38742fdf => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:26:29.361343 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:29.362219 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:29.369323 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:29.369816 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:29.370258 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:29.371007 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:29.371463 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:29.371888 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:29.398811 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Going to try to terminate instance {{(pid=121297) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 12:26:29.728766 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-824a3067-7b7e-4545-9dfe-31744020dccf tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 204 len: 0 microversion: 2.1 time: 0.371022 Oct 10 12:26:29.729373 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 797/1403] 10.222.0.46 () {58 vars in 1239 bytes} [Mon Oct 10 12:26:29 2022] DELETE /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 12:26:29.737867 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:29.746800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:29.746800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:29.746800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:29.746800 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:29.747211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:29.747211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:29.747211 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:29.882464 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:26:29.891143 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-41bbdfbb-ae2d-43d3-a5f6-8103e5797de2 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1555 microversion: 2.1 time: 0.157281 Oct 10 12:26:29.891728 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 798/1404] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:26:29 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:26:30.915854 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:30.916717 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:30.923218 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:30.923695 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:30.924126 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:30.924808 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:30.925252 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:30.927242 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:31.058278 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:26:31.066584 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-a1149fbe-7f9a-48b2-ad47-7130a9ee5abd tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1555 microversion: 2.1 time: 0.154971 Oct 10 12:26:31.066584 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 799/1405] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:26:30 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 12:26:32.090534 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:32.091237 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:32.097403 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:32.097886 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:32.098432 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:32.099152 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:32.099692 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:32.100020 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:32.232698 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:26:32.241777 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-b802cc96-25fb-4078-9be7-3dacdc88fbee tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1555 microversion: 2.1 time: 0.155067 Oct 10 12:26:32.242615 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 800/1406] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:26:32 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:26:32.308061 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [req-fcf54621-be0a-4cd0-98a7-0c79513d8305 req-5b21c875-48a0-4801-98fd-bda648978abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ee1609-eec2-4304-ba1b-49044ccb4649", "name": "network-vif-deleted", "tag": "646a539a-b920-4fec-9f0e-2812477d2113"}]} {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 12:26:32.318492 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-fcf54621-be0a-4cd0-98a7-0c79513d8305 req-5b21c875-48a0-4801-98fd-bda648978abf service nova] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:32.319080 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-fcf54621-be0a-4cd0-98a7-0c79513d8305 req-5b21c875-48a0-4801-98fd-bda648978abf service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:32.319516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [req-fcf54621-be0a-4cd0-98a7-0c79513d8305 req-5b21c875-48a0-4801-98fd-bda648978abf service nova] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:32.332273 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.compute.server_external_events [req-fcf54621-be0a-4cd0-98a7-0c79513d8305 req-5b21c875-48a0-4801-98fd-bda648978abf service nova] Creating event network-vif-deleted:646a539a-b920-4fec-9f0e-2812477d2113 for instance 33ee1609-eec2-4304-ba1b-49044ccb4649 on hv-cinder-86020 Oct 10 12:26:32.338151 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [req-fcf54621-be0a-4cd0-98a7-0c79513d8305 req-5b21c875-48a0-4801-98fd-bda648978abf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033908 Oct 10 12:26:32.338809 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 801/1407] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Oct 10 12:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 12:26:33.265496 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:33.266300 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:33.273518 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:33.274001 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:33.274439 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:33.275154 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:33.275607 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:33.276027 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:33.307089 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:33.307569 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:33.308005 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:33.308459 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.objects.instance [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lazy-loading 'fault' on Instance uuid 33ee1609-eec2-4304-ba1b-49044ccb4649 {{(pid=121297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 12:26:33.351747 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.policy [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db334d548cf45a7a338a7fcc30ac3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafe96e8ab4d498981d0e309c484c125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121297) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 12:26:33.359565 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-534370a9-e3ae-47f3-a5df-c9c05ab1cf7c tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 200 len: 1349 microversion: 2.1 time: 0.098310 Oct 10 12:26:33.360344 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 802/1408] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:26:33 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 12:26:34.383606 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:34.384308 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.compute.api [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] [instance: 33ee1609-eec2-4304-ba1b-49044ccb4649] Fetching instance by UUID {{(pid=121297) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 12:26:34.390917 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:34.391396 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:34.391830 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:34.392516 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Acquiring lock "4587e877-98cd-4f6e-b483-66663d295a9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 12:26:34.392959 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 12:26:34.393411 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG oslo_concurrency.lockutils [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Lock "4587e877-98cd-4f6e-b483-66663d295a9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121297) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 12:26:34.407841 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.wsgi [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] HTTP exception thrown: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 could not be found. Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Request method failure captured: Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: request: GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 HTTP/1.1 Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept: application/json Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Accept-Encoding: identity Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Connection: close Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Length: 0 Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Content-Type: application/json Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Host: 10.222.0.46 Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: Openstack-System-Scope: None Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: User-Agent: python-urllib3/1.26.12 Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Auth-Token: gAAAAABjRA6sfymgAEAsKTwH-YqfKB6f1ngweBapv8y-fJbY1NdUBm6kLAwVr5qD96GQgTGvdY4Qjlcxpxr4VIRN0BZno1KosnnzH1dswwOtuzakkYr0_feHiFjblByK3-PxJIClE2xJSGeOcOGTI-HHq1esRnp3E-jd9CJsxEs3O6WjULzTBLg Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Id: None Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Domain-Name: None Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Identity-Status: Confirmed Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Is-Admin-Project: True Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Id: default Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Domain-Name: Default Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Id: bafe96e8ab4d498981d0e309c484c125 Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Project-Name: tempest-TestMinimumBasicScenario-72401545 Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Role: member,reader Oct 10 12:26:34.409502 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Roles: member,reader Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bafe96e8ab4d498981d0e309c484c125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bafe96e8ab4d498981d0e309c484c125", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bafe96e8ab4d498981d0e309c484c125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bafe96e8ab4d498981d0e309c484c125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}] Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant: tempest-TestMinimumBasicScenario-72401545 Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Id: bafe96e8ab4d498981d0e309c484c125 Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-Tenant-Name: tempest-TestMinimumBasicScenario-72401545 Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User: tempest-TestMinimumBasicScenario-72401545-project Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Id: default Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Domain-Name: Default Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Id: 2db334d548cf45a7a338a7fcc30ac3c4 Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: X-User-Name: tempest-TestMinimumBasicScenario-72401545-project Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: method: > Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: exception: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 could not be found. Oct 10 12:26:34.411856 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: action_args: {'id': '33ee1609-eec2-4304-ba1b-49044ccb4649'} Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 could not be found. Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 12:26:34.412822 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 could not be found. Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 could not be found. Oct 10 12:26:34.414466 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: ERROR nova.api.openstack.wsgi Oct 10 12:26:34.415980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Returning 404 to user: Instance 33ee1609-eec2-4304-ba1b-49044ccb4649 could not be found. {{(pid=121297) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 12:26:34.415980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-fbec13ab-09f3-48d2-849f-a4c2e96b6294 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649" status: 404 len: 111 microversion: 2.1 time: 0.031785 Oct 10 12:26:34.415980 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 803/1409] 10.222.0.46 () {58 vars in 1236 bytes} [Mon Oct 10 12:26:34 2022] GET /compute/v2.1/servers/33ee1609-eec2-4304-ba1b-49044ccb4649 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 12:26:34.419843 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: DEBUG nova.api.openstack.wsgi [None req-64fcb032-d36a-445f-ac2b-6d5407574d57 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] Calling method '.version_select at 0x7f6d1284c0d0>' {{(pid=121297) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 12:26:34.499195 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: INFO nova.api.openstack.requestlog [None req-64fcb032-d36a-445f-ac2b-6d5407574d57 tempest-TestMinimumBasicScenario-72401545 tempest-TestMinimumBasicScenario-72401545-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1939953662" status: 202 len: 0 microversion: 2.1 time: 0.082831 Oct 10 12:26:34.499782 dv-cinder-860209-4-iscsi devstack@n-api.service[121297]: [pid: 121297|app: 0|req: 804/1410] 10.222.0.46 () {58 vars in 1272 bytes} [Mon Oct 10 12:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1939953662 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 12:28:23.723359 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:28:23.723968 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:28:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:28:23.734782 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:28:23.734918 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:28:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:28:30.987023 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:28:30.988344 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:28:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:31:43.733369 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:31:43.734063 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:31:43.743573 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:31:43.744226 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:31:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 10 12:31:51.000340 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 12:31:51.001067 dv-cinder-860209-4-iscsi devstack@n-api.service[121298]: Mon Oct 10 12:31:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!!